madoka
Memory-efficient CountMin Sketch key-value structure (based on Madoka C++ library)
Decision gist · record as of 2026-08-14
Yes, if you need memory-efficient approximate counting for streaming data and can tolerate ~0.0911% error. The package is stable (Alpha status, 12+ years old), has no known vulnerabilities, and supports modern Python versions. Install friction is moderate due to compiled wheels. Not suitable if you require exact counts or need to enumerate all keys.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Medium install friction due to compiled C++ extension with wheels available for Python 3.8–3.14 across Linux, macOS, and Windows platforms.
- Last release 257 days ago; repository is active but aging.
License · maintenance · safety
New BSD License (permissive) — New BSD License (permissive) allows commercial and private use with minimal restrictions.
last release 2025-11-30 (257 days) · last repo commit 2025-11-30 · 27 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 79,120 downloads/mo, #14,379 on PyPI
Alternatives
Verify before relying
import madoka
sketch = madoka.Sketch()
sketch['key'] += 1
value = sketch['key']- Whether the 0.0911% counting error rate applies uniformly across all Croquis variants or only to Sketch class.
- Performance characteristics and memory savings relative to dict/Counter for typical workloads.
- Whether Free Threading support (listed in classifiers) is fully functional or experimental.
What it is and what it does
Madoka is a Python wrapper around a C++ Count-Min sketch library that trades exact counting for memory efficiency. It provides multiple classes (Sketch, CroquisFloat, CroquisDouble, CroquisUint8/16/32/64) to store different numeric types, each using a probabilistic data structure that approximates frequencies with bounded error. Unlike a standard Python dict or Counter, a sketch uses fixed memory regardless of the number of unique keys, making it suitable for streaming scenarios where you cannot store all keys in memory.
The package supports typical counter operations—increment, add, set, get—plus sketch-specific operations like merge, shrink, inner product, and median. It can serialize to disk, load from file, and extract top-K most common keys if initialized with a k parameter. The tradeoff is that you cannot enumerate all keys (only top-K), and values are approximate rather than exact.
Use it for
- Approximate word frequency counting in large text streams where memory is constrained.
- Real-time traffic or event counting where exact counts are less important than memory efficiency.
- Merging frequency counts from multiple data sources with minimal memory overhead.
- Extracting top-K most frequent items from a stream without storing all unique items.
- Comparing similarity between two frequency distributions using inner product.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you need memory-efficient approximate counting for streaming data and can tolerate ~0.0911% error.
The package is stable (Alpha status, 12+ years old), has no known vulnerabilities, and supports modern Python versions. Install friction is moderate due to compiled wheels. Not suitable if you require exact counts or need to enumerate all keys.
Install
madoka on PyPI
Before you install
Medium install friction due to compiled C++ extension with wheels available for Python 3.8–3.14 across Linux, macOS, and Windows platforms. Last release 257 days ago; repository is active but aging.
License in practice
New BSD License (permissive) allows commercial and private use with minimal restrictions.
Quickstart
import madoka
sketch = madoka.Sketch()
sketch['key'] += 1
value = sketch['key']Verify before relying
- Whether the 0.0911% counting error rate applies uniformly across all Croquis variants or only to Sketch class.
- Performance characteristics and memory savings relative to dict/Counter for typical workloads.
- Whether Free Threading support (listed in classifiers) is fully functional or experimental.
Package facts
| License | New BSD License permissive |
| Python support | Not specified |
| Install friction | Medium. Platform-specific wheel |
| Runtime dependencies | None |
| Maintenance | Aging 257 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 79,120 / month, #14,379 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Development Status :: 3 - AlphaIntended Audience :: DevelopersIntended Audience :: Science/ResearchProgramming Language :: C++Programming Language :: PythonProgramming Language :: Python :: 3Programming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Programming Language :: Python :: 3.13Programming Language :: Python :: 3.14Programming Language :: Python :: 3.8Programming Language :: Python :: 3.9Programming Language :: Python :: Free ThreadingTopic :: Scientific/Engineering :: Information AnalysisTopic :: Software Development :: Libraries :: Python ModulesTopic :: Text Processing :: Linguistic |
Evidence: madoka-0.7.2.1-cp310-cp310-macosx_10_9_universal2.whl; madoka-0.7.2.1-cp310-cp310-macosx_10_9_x86_64.whl; madoka-0.7.2.1-cp310-cp310-macosx_11_0_arm64.whl; madoka-0.7.2.1-cp310-cp310-manylinux2014_aarch64.manylinux_2_17_aarch64.manylinux_2_28_aarch64.whl; madoka-0.7.2.1-cp310-cp310-manylinux2014_ppc64le.manylinux_2_17_ppc64le.manylinux_2_28_ppc64le.whl; madoka-0.7.2.1-cp310-cp310-manylinux2014_s390x.manylinux_2_17_s390x.manylinux_2_28_s390x.whl; madoka-0.7.2.1-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl; madoka-0.7.2.1-cp310-cp310-musllinux_1_2_aarch64.whl; madoka-0.7.2.1-cp310-cp310-musllinux_1_2_ppc64le.whl; madoka-0.7.2.1-cp310-cp310-musllinux_1_2_s390x.whl; madoka-0.7.2.1-cp310-cp310-musllinux_1_2_x86_64.whl; madoka-0.7.2.1-cp310-cp310-win32.whl; madoka-0.7.2.1-cp310-cp310-win_amd64.whl; madoka-0.7.2.1-cp310-cp310-win_arm64.whl; madoka-0.7.2.1-cp311-cp311-macosx_10_9_universal2.whl; madoka-0.7.2.1-cp311-cp311-macosx_10_9_x86_64.whl; madoka-0.7.2.1-cp311-cp311-macosx_11_0_arm64.whl; madoka-0.7.2.1-cp311-cp311-manylinux2014_aarch64.manylinux_2_17_aarch64.manylinux_2_28_aarch64.whl; madoka-0.7.2.1-cp311-cp311-manylinux2014_ppc64le.manylinux_2_17_ppc64le.manylinux_2_28_ppc64le.whl; madoka-0.7.2.1-cp311-cp311-manylinux2014_s390x.manylinux_2_17_s390x.manylinux_2_28_s390x.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “count-min sketch”
- madokaMadoka implements a Count-Min sketch data structure for…
- pyprobablesProvides pure-Python implementations of probabilistic data structures…
- fig2sketchConverts Figma .fig design files into Sketch .sketch documents that…
Give your agent the search over MCP, or paste the wish link into any chat.
More Python Modules packages
Converts domain names between Unicode and ASCII-compatible encoding (Punycode) according to IDNA 2008 and Unicode Technical Standard 46, with security validation and broader script coverage than the standard library.
Install it if you work with internationalized domain names, need to validate domains, or use HTTP clients that depend on it transitively.
Setuptools is a Python build backend and package management tool that handles building, distributing, and installing Python packages, including support for C/C++ extension modules.
PyYAML parses and emits YAML 1.1 data format, enabling serialization and deserialization of configuration files and Python objects to and from human-readable YAML text.
Pydantic validates Python data structures against type hints, coercing and checking input at runtime to ensure it matches a declared schema.
Provides reusable metadata objects for use with PEP-593 `typing.Annotated` to express common constraints like bounds, collection sizes, and predicates on types.
Install it if you use or build libraries that need to express type constraints in a standardized, inspectable way—or if you want to annotate your own types with…
Provides runtime tools to inspect and introspect Python type annotations, enabling programmatic examination of type hints at execution time.
See also datasketches · datasketch · syllapy · pyprobables · crick · ddsketch · whylogs-sketching · json-stream · multidict · HLL