{"categories":[{"label":"Python Modules","url":"https://skillfed.io/packages/category/software-development-libraries-python-modules/14"}],"enrichment":{"capability":"A pure-Python client library for Apache Kafka that provides high-level producer and consumer APIs designed to mirror the official Java client, with support for consumer groups, message serialization, and compression.","skillfed_tags":["message-queue","streaming","distributed-systems"],"use_cases":["Build a consumer application that subscribes to a Kafka topic and processes messages in a consumer group with automatic partition rebalancing","Implement an asynchronous message producer that sends events to Kafka with optional compression and key-based partitioning","Set up multi-consumer message processing by manually assigning different partitions to consumer instances using configuration management","Integrate custom serialization (JSON, msgpack, etc.) for message values and keys in producer and consumer workflows","Probe and test Kafka broker compatibility by using the protocol layer to check broker versions (0.8.0 to 0.11)"],"what_it_does":"kafka-python is a pure-Python client for Apache Kafka that lets you produce and consume messages from Kafka brokers without external compiled dependencies. It provides two main APIs: KafkaConsumer for reading messages (with support for consumer groups and dynamic partition assignment on brokers 0.9+) and KafkaProducer for writing messages asynchronously. Both are designed to behave similarly to the official Java client, with Pythonic additions like consumer iterators. The library handles serialization, compression (gzip natively; lz4 and snappy via optional packages), and protocol-level operations.\n\nThe package is best suited for Kafka 0.9 and newer brokers, though it remains backward-compatible with 0.8.0. It supports thread-safe producer usage but recommends multiprocessing for consumers. No runtime dependencies means installation is straightforward, and the large download volume and production-stable status indicate it is widely used in production systems.","worth_installing":"Yes. kafka-python is production-stable, widely adopted (254199 monthly downloads, top 15000 on PyPI), has zero known vulnerabilities, and carries a permissive Apache License 2.0. Installation is frictionless with no runtime dependencies. The only caveat is that the last release was 2017-10-07; verify that this aligns with your support expectations and that the package still meets your target Kafka broker and Python version requirements."},"id":"kafka","links":{"html":"https://skillfed.io/packages/kafka","md":"https://skillfed.io/packages/kafka.md","pypi":"https://pypi.org/project/kafka/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2017-10-07","license_spdx":null,"license_treatment":"permissive","name":"kafka","python_support":"unspecified","summary":"Pure Python client for Apache Kafka"},"popularity":{"monthly_downloads":254199,"position":8500,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"1.3.5"}