streamsets

What it is and what it does

StreamSets is a Python SDK that lets you automate and script interactions with StreamSets data integration products. It wraps the APIs of Control Hub, Data Collector, Transformer, and Transformer for Snowflake, allowing you to build pipelines, manage jobs, and orchestrate data flows programmatically instead of through the web UI. The package depends on dpath, inflection, PyYAML, and requests to handle data navigation, naming conventions, configuration, and HTTP communication.

The SDK is split into two lineages: versions 4.0.0 and above target the StreamSets Platform, while earlier versions support legacy StreamSets products. You need to match your SDK version to your product version before installing. The package is actively maintained, supports modern Python versions, and has no known security vulnerabilities.

Use it for:

• Automate pipeline creation and deployment across multiple StreamSets Control Hub instances from a CI/CD workflow.
• Build monitoring scripts that query Data Collector or Transformer job status and metrics programmatically.
• Orchestrate Transformer for Snowflake jobs as part of a larger Python-based data orchestration system.
• Generate and manage StreamSets configurations from templates using Python, then deploy them via the SDK.
• Integrate StreamSets pipeline execution into a Python application that needs to trigger and track data flows.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

A Python SDK for programmatically interacting with StreamSets products including Control Hub, Data Collector, Transformer, and Transformer for Snowflake.

Yes, if you use StreamSets products and need to automate or script interactions with them. Install friction is low and maintenance is active. However, verify that your SDK version matches your StreamSets product version (Platform vs. Legacy), and resolve the unclear license status before adopting in a commercial context. No security vulnerabilities are known.

Install

streamsets on PyPI

pip install streamsets

uv add streamsets

poetry add streamsets

Installing streamsets

Before you install

Low install friction with four straightforward runtime dependencies. Actively maintained with a release 46 days ago. Supports current Python versions from 3.10 through 3.15.

License in practice

License treatment is unclear—no SPDX identifier or raw license text is available in the package metadata. Verify the actual license terms before adopting this package in a commercial or restricted-license context.

Quickstart

pip install streamsets

import streamsets
# Instantiate a client for your StreamSets product and call its API methods

Requires Python 3.10 or higher. Verify SDK version compatibility with your StreamSets product version (4.0.0+ for Platform, below 4.0.0 for Legacy products).

Verify before relying

• Exact API surface and available methods for each supported StreamSets product (Control Hub, Data Collector, Transformer, Transformer for Snowflake)
• Whether the package is suitable for production use in your specific StreamSets deployment architecture
• Performance characteristics and rate-limiting behavior when interacting with StreamSets APIs

Package facts

Evidence: streamsets-7.0.2-py3-none-any.whl

Tags

More Application Frameworks packages