quixstreams

What it is and what it does

Quix Streams is a Python library for building stream processing applications that consume, transform, and produce data on Apache Kafka topics. It provides a declarative DataFrame-like API for defining data pipelines, with support for windowing, joins, branching, and group-by operations. The framework handles Kafka's consumer groups, message deserialization, state management, and exactly-once processing semantics automatically, letting you focus on transformation logic rather than infrastructure.

The library depends on confluent-kafka for Kafka protocol support, pydantic for configuration validation, orjson and jsonschema for serialization, and rocksdict for fault-tolerant state storage. It runs anywhere Python is installed and can be deployed to your own infrastructure or to Quix Cloud for managed hosting. The framework is designed for both simple producer-consumer applications and complex event-driven systems, real-time analytics, and machine learning pipelines.

Use it for

• Build real-time alerting systems that consume sensor or application data from Kafka, filter or aggregate it, and produce alerts to downstream topics.
• Process time-series data with windowing and stateful operations to compute rolling metrics, anomaly detection, or trend analysis.
• Create event-driven microservice architectures where services consume domain events, apply business logic, and emit new events for other services.
• Enrich incoming data streams by joining them with reference data or state, then produce enriched records to output topics.
• Implement exactly-once data pipelines that transform and load data from Kafka into data warehouses or analytics systems without duplication.

Worth the install?

AI-flagged interpretation of the facts on this page. Verify before relying on it.

Install

quixstreams on PyPI

Before you install

Low install friction with a pure-Python wheel and 11 runtime dependencies. Active maintenance with a release 21 days ago and ongoing commits; the project has 1567 GitHub stars and reached production stability.

Requires Python 3.9 or later and Apache Kafka 0.10 or later accessible at the broker address.

License in practice

Licensed under Apache 2.0 (permissive), allowing commercial use, modification, and distribution with minimal restrictions—you must include a copy of the license and note any changes you make.

Quickstart

pip install quixstreams

from quixstreams import Application

app = Application(broker_address="localhost:9092")
topic = app.topic("input-topic", value_deserializer="json")
sdf = app.dataframe(topic=topic)
sdf = sdf.apply(lambda value: {"processed": value})
app.run()

Package facts

Evidence: quixstreams-3.25.0-py3-none-any.whl

Tags

More Application Frameworks packages

See also faust-streaming · faststream · kafka · apache-flink · kafka-python · matrice-streaming · broadcaster · confluent-kafka · snowpipe-streaming · beam-nuggets