{"categories":[{"label":"Python Modules","url":"https://skillfed.io/packages/category/software-development-libraries-python-modules/6"}],"enrichment":{"capability":"A Python client library for Apache Kafka that provides high-level producer and consumer APIs for publishing and consuming messages from Kafka brokers, with support for consumer groups, compression, and serialization.","skillfed_tags":["kafka","message-streaming","abandoned-upstream"],"use_cases":["Build a consumer application that subscribes to Kafka topics and processes messages in a consumer group with automatic partition rebalancing.","Implement a producer that publishes messages to Kafka topics with optional key-based partitioning and compression.","Integrate Kafka message streaming into Python microservices for event-driven architectures.","Serialize and deserialize structured data (JSON, msgpack) when producing or consuming Kafka messages.","Monitor Kafka producer and consumer performance using the metrics() API."],"what_it_does":"kafka-python-ng is a pure Python client for Apache Kafka that mirrors the design of the official Java client. It provides KafkaConsumer for subscribing to topics and consuming messages (with support for consumer groups and dynamic partition assignment on brokers 0.9+) and KafkaProducer for asynchronously publishing messages. The library handles serialization, compression (gzip natively, plus optional LZ4, Snappy, and Zstandard), and CRC32 validation of messages.\n\nThe package is designed to work with modern Kafka brokers (0.9+) but maintains backward compatibility to 0.8.0, though some features like coordinated consumer groups require newer brokers. It supports Python 3.8 through 3.12 on CPython and PyPy. The library includes a protocol layer for low-level broker interaction and version detection, useful for testing and experimentation.","worth_installing":"Yes, with caution. The package has low install friction, no runtime dependencies, and covers the core Kafka client use case well. However, the repository is archived and abandoned as of 2024-10-28, with the description itself recommending use of the GitHub repository due to release issues. For new projects, verify whether the fork remains actively maintained or whether you should evaluate alternatives. For existing projects already using it, the current version is stable and has no known vulnerabilities, but plan for long-term maintenance risk."},"id":"kafka-python-ng","links":{"html":"https://skillfed.io/packages/kafka-python-ng","md":"https://skillfed.io/packages/kafka-python-ng.md","pypi":"https://pypi.org/project/kafka-python-ng/"},"maintenance":{"status":"abandoned"},"meta":{"latest_release":"2024-10-02","license_spdx":null,"license_treatment":"permissive","name":"kafka-python-ng","python_support":"supports_current","summary":"Pure Python client for Apache Kafka"},"popularity":{"monthly_downloads":1915400,"position":3435,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"2.2.3"}
