aws-kinesis-agg
Python module to assist in taking advantage of the Kinesis message aggregation format for both aggregation and deaggregation.
Decision gist · record as of 2026-08-14
Yes, if you are building a Kinesis producer and need to optimize throughput and costs through record aggregation, and your data is non-critical or can tolerate occasional loss. No, if you require active maintenance, modern Python version support guarantees, or are processing sensitive data where every message must be reliably delivered. The dormant maintenance status and lack of recent updates mean you should verify compatibility with your protobuf and Python versions before adopting.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires protobuf to be installed (handled automatically by pip); Python 2.7 or 3.6+ support as stated in classifiers, but compatibility with newer versions is unverified.
- Low install friction with a single runtime dependency (protobuf).
- Maintenance is dormant—last release was 2022-06-10 and last commit 2024-10-04—so expect no active bug fixes or feature updates, though the codebase is stable and marked Production/Stable.
License · maintenance · safety
Apache-2.0 (permissive) — Apache-2.0 is permissive; you can use this in commercial and proprietary projects with minimal restrictions, provided you include a copy of the license and note any modifications.
last release 2022-06-10 (1526 days) · last repo commit 2024-10-04 · 379 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 207,582 downloads/mo, #9,546 on PyPI
Alternatives
Verify before relying
pip install aws_kinesis_agg
import aws_kinesis_agg.aggregator
kinesis_aggregator = aws_kinesis_agg.aggregator.RecordAggregator()
result = kinesis_aggregator.add_user_record('partition_key', b'data', None)
if result:
pk, ehk, data = result.get_contents()
# Send to Kinesis- Whether the package remains compatible with current versions of protobuf and modern Python versions beyond 3.6.
- Real-world data loss scenarios mentioned in the documentation and whether they apply to your use case.
What it is and what it does
aws_kinesis_agg provides Python classes to pack multiple Kinesis user records into aggregated records using the Kinesis Aggregated Record Format, and to unpack aggregated records back into individual user records. On the producer side, it offers both iterative and callback-based aggregation modes, letting you batch records efficiently before sending to Kinesis; on the consumer side, it deaggregates records received from Kinesis (including those from the Kinesis Producer Library) into their original form.
The package is designed to reduce transmission costs and improve throughput by combining multiple small records into larger ones that fit within a single PutRecord request. It depends only on protobuf for serialization. The documentation cautions that aggregation is suitable only for low-value, non-critical messages; it is not recommended for sensitive data or scenarios where every message must be guaranteed delivery, especially when using the Kinesis Client Library or AWS Lambda for processing.
Use it for
- Batch small telemetry or log events into aggregated Kinesis records to reduce API call costs and improve producer throughput.
- Deaggregate records received from Kinesis streams or Lambda events that were created by the Kinesis Producer Library.
- Build a producer application that packs records iteratively, checking byte size or record count to trigger transmission when full.
- Implement callback-based aggregation to automatically send packed records to Kinesis as soon as they reach target size.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you are building a Kinesis producer and need to optimize throughput and costs through record aggregation, and your data is non-critical or can tolerate occasional loss.
No, if you require active maintenance, modern Python version support guarantees, or are processing sensitive data where every message must be reliably delivered. The dormant maintenance status and lack of recent updates mean you should verify compatibility with your protobuf and Python versions before adopting.
Install
aws-kinesis-agg on PyPI
Before you install
Low install friction with a single runtime dependency (protobuf). Maintenance is dormant—last release was 2022-06-10 and last commit 2024-10-04—so expect no active bug fixes or feature updates, though the codebase is stable and marked Production/Stable.
Requires protobuf to be installed (handled automatically by pip); Python 2.7 or 3.6+ support as stated in classifiers, but compatibility with newer versions is unverified.
License in practice
Apache-2.0 is permissive; you can use this in commercial and proprietary projects with minimal restrictions, provided you include a copy of the license and note any modifications.
Quickstart
pip install aws_kinesis_agg
import aws_kinesis_agg.aggregator
kinesis_aggregator = aws_kinesis_agg.aggregator.RecordAggregator()
result = kinesis_aggregator.add_user_record('partition_key', b'data', None)
if result:
pk, ehk, data = result.get_contents()
# Send to KinesisVerify before relying
- Whether the package remains compatible with current versions of protobuf and modern Python versions beyond 3.6.
- Real-world data loss scenarios mentioned in the documentation and whether they apply to your use case.
Package facts
| License | Apache-2.0 permissive |
| Python support | Not specified |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 1 packageprotobuf |
| Maintenance | Dormant 1,526 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 207,582 / month, #9,546 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Development Status :: 5 - Production/StableIntended Audience :: DevelopersLicense :: OSI Approved :: Apache Software LicenseNatural Language :: EnglishOperating System :: OS IndependentProgramming Language :: PythonProgramming Language :: Python :: 2.7Programming Language :: Python :: 3.6Topic :: Software Development :: Libraries :: Python ModulesTopic :: Utilities |
Evidence: aws_kinesis_agg-1.2.3-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “kinesis record aggregation”
- aws-kinesis-aggAggregates and deaggregates Kinesis records using the Kinesis…
- aws-logging-handlersRoutes Python logging records to AWS S3 and Kinesis using…
- types-aiobotocore-kinesisProvides type annotations and IDE autocompletion for aiobotocore's…
Give your agent the search over MCP, or paste the wish link into any chat.
More Python Modules packages
Converts domain names between Unicode and ASCII-compatible encoding (Punycode) according to IDNA 2008 and Unicode Technical Standard 46, with security validation and broader script coverage than the standard library.
Install it if you work with internationalized domain names, need to validate domains, or use HTTP clients that depend on it transitively.
Setuptools is a Python build backend and package management tool that handles building, distributing, and installing Python packages, including support for C/C++ extension modules.
PyYAML parses and emits YAML 1.1 data format, enabling serialization and deserialization of configuration files and Python objects to and from human-readable YAML text.
Pydantic validates Python data structures against type hints, coercing and checking input at runtime to ensure it matches a declared schema.
Provides reusable metadata objects for use with PEP-593 `typing.Annotated` to express common constraints like bounds, collection sizes, and predicates on types.
Install it if you use or build libraries that need to express type constraints in a standardized, inspectable way—or if you want to annotate your own types with…
Provides runtime tools to inspect and introspect Python type annotations, enabling programmatic examination of type hints at execution time.
See also aws-cdk.aws-kinesis · aws-logging-handlers · aws-cdk.aws-kinesisfirehose-alpha · aws-cdk.aws-kinesisfirehose-destinations-alpha · s3transfer · aws-cdk.aws-kinesisanalytics-flink-alpha · s3torchconnector · s3torchconnectorclient · logging-json · aws-cdk.aws-logs