icechunk
Icechunk Python
Decision gist · record as of 2026-08-14
Yes, if you need transactional, multi-process-safe tensor storage on cloud object storage with Zarr. The package is actively maintained, has no known vulnerabilities, and supports current Python versions. However, verify the license treatment before use in proprietary contexts, and confirm that the Apache 2.0 license mentioned in the description is formally declared. Medium install friction is acceptable for most environments given the availability of prebuilt wheels.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires Python 3.12 or later; Zarr must be installed as a runtime dependency.
- Medium install friction due to compiled Rust bindings; wheels are available for current Python versions (3.12+) and common platforms (x86_64, arm64, macOS, Linux, Windows).
- Active maintenance with recent release.
License · maintenance · safety
(unclear) — License treatment is unclear; the description excerpt mentions Apache 2.0, but the metadata does not confirm this. Verify the actual license before use in proprietary or restricted contexts.
last release 2026-07-29 (16 days)
0 known vulnerabilities (OSV.dev, 2026-08-14) · 276,005 downloads/mo, #8,169 on PyPI
Alternatives
Verify before relying
pip install icechunk
import zarr
from icechunk import IcechunkStore
store = IcechunkStore(root="s3://bucket/path")
group = zarr.open_group(store=store, mode="r+")- Whether Apache 2.0 license claimed in description excerpt is formally declared in package metadata
- Specific cloud storage backends supported beyond the description's mention of GCS, Azure, and S3
- Performance characteristics and scalability limits for concurrent transactions
- Compatibility with Zarr implementations other than Zarr Python
What it is and what it does
Icechunk augments Zarr with transactional guarantees and version control for multidimensional array data stored on cloud object storage. It presents a key-value interface to Zarr while managing all I/O, enabling safe parallel reads and writes from multiple uncoordinated processes without external locks or databases. A repo is a self-contained Zarr store (typically a group with multiple related arrays) that supports snapshots, branches, tags, and time-travel access to previous versions.
The package is built on Rust bindings (PyO3) and provides serializable isolation—reads always see committed snapshots, writes are atomic and never partially visible. It supports chunk sharding, chunk references to external formats like HDF5, and schema evolution. Icechunk is designed for scientific computing, data science, and AI/ML workflows where consistent, versioned tensor storage on cloud infrastructure is required.
Use it for
- Store and version large multidimensional datasets (e.g., climate, geospatial, or scientific simulations) on S3 or other cloud storage with transactional safety.
- Enable multiple concurrent processes to read and write to the same Zarr arrays without coordination or locking.
- Maintain immutable snapshots and branches of tensor data for reproducibility and time-travel debugging.
- Organize related arrays into hierarchical groups with schema evolution (add, rename, remove arrays with minimal overhead).
- Reference chunks from external file formats (HDF5, NetCDF) within a Zarr-compatible store.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you need transactional, multi-process-safe tensor storage on cloud object storage with Zarr.
The package is actively maintained, has no known vulnerabilities, and supports current Python versions. However, verify the license treatment before use in proprietary contexts, and confirm that the Apache 2.0 license mentioned in the description is formally declared. Medium install friction is acceptable for most environments given the availability of prebuilt wheels.
Install
icechunk on PyPI
Before you install
Medium install friction due to compiled Rust bindings; wheels are available for current Python versions (3.12+) and common platforms (x86_64, arm64, macOS, Linux, Windows). Active maintenance with recent release.
Requires Python 3.12 or later; Zarr must be installed as a runtime dependency.
License in practice
License treatment is unclear; the description excerpt mentions Apache 2.0, but the metadata does not confirm this. Verify the actual license before use in proprietary or restricted contexts.
Quickstart
pip install icechunk
import zarr
from icechunk import IcechunkStore
store = IcechunkStore(root="s3://bucket/path")
group = zarr.open_group(store=store, mode="r+")Verify before relying
- Whether Apache 2.0 license claimed in description excerpt is formally declared in package metadata
- Specific cloud storage backends supported beyond the description's mention of GCS, Azure, and S3
- Performance characteristics and scalability limits for concurrent transactions
- Compatibility with Zarr implementations other than Zarr Python
Package facts
| License | Not declared unclear |
| Python support | Supports the current Python release >=3.12 |
| Install friction | Medium. Platform-specific wheel |
| Runtime dependencies | 1 packagezarr |
| Maintenance | Actively maintained 16 days since the last release |
| First released | |
| Downloads | 276,005 / month, #8,169 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Programming Language :: Python :: 3Programming Language :: Python :: 3.12Programming Language :: Python :: 3.13Programming Language :: Python :: 3.14Programming Language :: Python :: Implementation :: CPythonProgramming Language :: Rust |
Evidence: icechunk-2.1.2-cp312-abi3-macosx_10_12_x86_64.whl; icechunk-2.1.2-cp312-abi3-macosx_11_0_arm64.whl; icechunk-2.1.2-cp312-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl; icechunk-2.1.2-cp312-abi3-manylinux_2_28_aarch64.whl; icechunk-2.1.2-cp312-abi3-musllinux_1_2_aarch64.whl; icechunk-2.1.2-cp312-abi3-musllinux_1_2_x86_64.whl; icechunk-2.1.2-cp312-abi3-win_amd64.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “zarr transactional storage”
- icechunkIcechunk is a transactional storage engine for tensor/ND-array data…
- tensorstoreTensorStore reads and writes large multi-dimensional arrays across…
- pydantic-zarrProvides Pydantic models for reading, validating, and working with…
Give your agent the search over MCP, or paste the wish link into any chat.
More Database packages
psycopg2-binary is a PostgreSQL database adapter for Python that implements the DB API 2.0 specification, enabling Python applications to connect to and query PostgreSQL databases with thread-safe concurrent operations.
Python client library for connecting to and executing commands against Redis key-value stores, supporting both synchronous and asynchronous operations.
Install it if your application needs to interact with Redis; the only prerequisite is a running Redis server instance.
YDB Python SDK is the official client library for connecting to and querying YDB databases from Python applications.
Install it if you need to connect Python applications to YDB databases.
Connects Python applications to Snowflake data warehouses using the DB API 2.0 specification, enabling SQL queries, data transfers, and warehouse operations.
sqlparse tokenizes SQL text into a tree of statements, clauses, and expressions, and provides functions to split scripts, format queries, and inspect parsed tokens without validating dialect or syntax.
Install it if you need to manipulate, format, or analyze SQL text programmatically.
Provides base adapter protocols and shared functionality that database adapters use to integrate with dbt-core, handling connections, dialect translation, relation caching, and core interface management.
See also kerchunk · tensorstore · chonkie-core · ome-zarr · memchunk · pydantic-zarr · raft-dask-cu12 · chonkie · repoze-sendmail · libkvikio-cu12