omnimalloc
Your one-stop shop for static memory allocation.
Decision gist · record as of 2026-08-14
Yes, if you are building ML compilers, embedded runtimes, or accelerator toolchains that need to optimize static memory allocation. The library is actively maintained, has no known vulnerabilities, supports current Python versions (3.10–3.14), and offers both a practical allocator (SuperMalloc) and a framework for developing new strategies. Install friction is moderate due to compiled wheels, but pre-built binaries are available for common platforms. Not relevant for general Python development.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires Python 3.10 or later; compiled wheels available for macOS (ARM64), Linux (x86_64, aarch64), and Windows (amd64).
- Medium install friction due to compiled wheels for multiple Python versions (3.10–3.14) and platforms, but wheels are pre-built for common architectures.
- Active maintenance with a release 2 days old and last commit on 2026-08-13.
License · maintenance · safety
Apache-2.0 (permissive) — Licensed under Apache-2.0 (permissive), allowing commercial and private use with minimal restrictions; attribution required.
last release 2026-08-12 (2 days) · last repo commit 2026-08-13 · 4 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 91,315 downloads/mo, #13,524 on PyPI
Alternatives
Verify before relying
pip install omnimalloc
import omnimalloc as om
pool = om.Pool(
id="pool",
allocations=(
om.Allocation(id=0, size=64, start=0, end=10),
om.Allocation(id=1, size=64, start=12, end=20),
om.Allocation(id=2, size=32, start=5, end=15),
),
)
pool = om.allocate(pool, allocator="supermalloc", validate=True)
print(pool.size)- Whether SuperMalloc's performance advantage holds across all workload types or only specific ML compiler scenarios.
- API stability and backward compatibility guarantees for future releases beyond 1.0.0.
- Detailed memory overhead of the allocator itself relative to peak savings achieved.
What it is and what it does
OmniMalloc is a Python library that solves the static memory allocation problem: given a set of buffers with known sizes and lifetimes, it computes optimal offsets so that peak memory usage is minimized. This is a core step in ML compilers, embedded runtimes, and accelerator toolchains. The library wraps a C++ backend and exposes multiple allocation algorithms—including SuperMalloc, a new allocator claimed to outperform open-source alternatives—behind a single Python API.
You define allocations with size and lifetime intervals (half-open ranges where lifetimes that touch never conflict), then call allocate() with your choice of allocator strategy. The library returns a plan with assigned offsets for each buffer. It also ships benchmark harness and visualization tools to evaluate allocation strategies on real workloads.
Use it for
- Optimize memory layout for ML model inference on embedded or accelerator devices with fixed memory budgets.
- Plan static buffer allocation for neural network compilation pipelines to reduce peak memory footprint.
- Benchmark and compare different allocation strategies on real workloads using the built-in harness.
- Develop and prototype new allocation algorithms using the library's framework and visualization tools.
- Pack multiple buffers with non-overlapping lifetimes into shared memory pools for resource-constrained environments.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you are building ML compilers, embedded runtimes, or accelerator toolchains that need to optimize static memory allocation.
The library is actively maintained, has no known vulnerabilities, supports current Python versions (3.10–3.14), and offers both a practical allocator (SuperMalloc) and a framework for developing new strategies. Install friction is moderate due to compiled wheels, but pre-built binaries are available for common platforms. Not relevant for general Python development.
Install
omnimalloc on PyPI
Before you install
Medium install friction due to compiled wheels for multiple Python versions (3.10–3.14) and platforms, but wheels are pre-built for common architectures. Active maintenance with a release 2 days old and last commit on 2026-08-13.
Requires Python 3.10 or later; compiled wheels available for macOS (ARM64), Linux (x86_64, aarch64), and Windows (amd64).
License in practice
Licensed under Apache-2.0 (permissive), allowing commercial and private use with minimal restrictions; attribution required.
Quickstart
pip install omnimalloc
import omnimalloc as om
pool = om.Pool(
id="pool",
allocations=(
om.Allocation(id=0, size=64, start=0, end=10),
om.Allocation(id=1, size=64, start=12, end=20),
om.Allocation(id=2, size=32, start=5, end=15),
),
)
pool = om.allocate(pool, allocator="supermalloc", validate=True)
print(pool.size)Verify before relying
- Whether SuperMalloc's performance advantage holds across all workload types or only specific ML compiler scenarios.
- API stability and backward compatibility guarantees for future releases beyond 1.0.0.
- Detailed memory overhead of the allocator itself relative to peak savings achieved.
Package facts
| License | Apache-2.0 permissive |
| Python support | Supports the current Python release >=3.10 |
| Install friction | Medium. Platform-specific wheel |
| Runtime dependencies | 1 packagetyping-extensions |
| Maintenance | Actively maintained 2 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 91,315 / month, #13,524 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Development Status :: 5 - Production/StableIntended Audience :: DevelopersIntended Audience :: Science/ResearchOperating System :: OS IndependentProgramming Language :: C++Programming Language :: Python :: 3Programming Language :: Python :: 3 :: OnlyProgramming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Programming Language :: Python :: 3.13Programming Language :: Python :: 3.14Topic :: Scientific/EngineeringTopic :: Software Development :: Libraries :: Python ModulesTyping :: Typed |
Evidence: omnimalloc-1.0.0-cp310-cp310-macosx_11_0_arm64.whl; omnimalloc-1.0.0-cp310-cp310-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl; omnimalloc-1.0.0-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl; omnimalloc-1.0.0-cp310-cp310-win_amd64.whl; omnimalloc-1.0.0-cp311-cp311-macosx_11_0_arm64.whl; omnimalloc-1.0.0-cp311-cp311-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl; omnimalloc-1.0.0-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl; omnimalloc-1.0.0-cp311-cp311-win_amd64.whl; omnimalloc-1.0.0-cp312-cp312-macosx_11_0_arm64.whl; omnimalloc-1.0.0-cp312-cp312-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl; omnimalloc-1.0.0-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl; omnimalloc-1.0.0-cp312-cp312-win_amd64.whl; omnimalloc-1.0.0-cp313-cp313-macosx_11_0_arm64.whl; omnimalloc-1.0.0-cp313-cp313-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl; omnimalloc-1.0.0-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl; omnimalloc-1.0.0-cp313-cp313-win_amd64.whl; omnimalloc-1.0.0-cp314-cp314-macosx_11_0_arm64.whl; omnimalloc-1.0.0-cp314-cp314-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl; omnimalloc-1.0.0-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl; omnimalloc-1.0.0-cp314-cp314-win_amd64.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “static memory allocation neural networks”
- omnimallocOmniMalloc solves static memory allocation for neural networks by…
- qonnxQONNX provides Python utilities to work with quantized neural…
- tensorrtTensorRT compiles and optimizes deep learning models for deployment…
Give your agent the search over MCP, or paste the wish link into any chat.
More Scientific/Engineering packages
NumPy provides an N-dimensional array object and a comprehensive suite of mathematical, linear algebra, Fourier transform, and random number functions for scientific computing in Python.
pandas provides fast, flexible data structures (Series and DataFrame) for loading, cleaning, transforming, and analyzing labeled or relational data in Python.
scipy provides numerical algorithms for mathematics, science, and engineering—including optimization, integration, linear algebra, Fourier transforms, signal and image processing, and ODE solvers—built on numpy arrays.
scikit-learn provides a comprehensive Python library for supervised and unsupervised machine learning, including classification, regression, clustering, dimensionality reduction, and model evaluation tools built on NumPy and SciPy.
Install it if you need to train, evaluate, or deploy supervised or unsupervised learning models.
dill extends Python's pickle module to serialize and deserialize a much wider range of Python objects, including functions, lambdas, classes, and interpreter sessions, to byte streams for storage or network transmission.
Multiprocess is an enhanced fork of Python's standard multiprocessing library that uses dill for better serialization, allowing you to spawn processes with a threading-like API and share complex objects between them.
Install it if you use multiprocessing and encounter pickle serialization limits with lambdas or complex objects.
See also umf · mnn · HLL · comfy-aimdo · rmm-cu12 · lion-pytorch · librmm-cu12 · onnx-tool · sgl-kernel · pytest-memray