---
id: icechunk
version: "2.1.2"
license: unclear
license_treatment: unclear
maintenance: active
---

# icechunk — Icechunk Python

License: unclear · Maintenance: active · Downloads: 276.0K/mo

## What it is and what it does

Icechunk augments Zarr with transactional guarantees and version control for multidimensional array data stored on cloud object storage. It presents a key-value interface to Zarr while managing all I/O, enabling safe parallel reads and writes from multiple uncoordinated processes without external locks or databases. A repo is a self-contained Zarr store (typically a group with multiple related arrays) that supports snapshots, branches, tags, and time-travel access to previous versions.

The package is built on Rust bindings (PyO3) and provides serializable isolation—reads always see committed snapshots, writes are atomic and never partially visible. It supports chunk sharding, chunk references to external formats like HDF5, and schema evolution. Icechunk is designed for scientific computing, data science, and AI/ML workflows where consistent, versioned tensor storage on cloud infrastructure is required.

Use it for:

- Store and version large multidimensional datasets (e.g., climate, geospatial, or scientific simulations) on S3 or other cloud storage with transactional safety.
- Enable multiple concurrent processes to read and write to the same Zarr arrays without coordination or locking.
- Maintain immutable snapshots and branches of tensor data for reproducibility and time-travel debugging.
- Organize related arrays into hierarchical groups with schema evolution (add, rename, remove arrays with minimal overhead).
- Reference chunks from external file formats (HDF5, NetCDF) within a Zarr-compatible store.

## Worth the install?

AI-flagged interpretation of the facts above — verify before relying.

Icechunk is a transactional storage engine for tensor/ND-array data that works with Zarr to provide consistent, multi-process-safe reads and writes on cloud object storage.

Yes, if you need transactional, multi-process-safe tensor storage on cloud object storage with Zarr. The package is actively maintained, has no known vulnerabilities, and supports current Python versions. However, verify the license treatment before use in proprietary contexts, and confirm that the Apache 2.0 license mentioned in the description is formally declared. Medium install friction is acceptable for most environments given the availability of prebuilt wheels.

## Install

pip install icechunk
uv add icechunk
poetry add icechunk

## Installing icechunk

Before you install: Medium install friction due to compiled Rust bindings; wheels are available for current Python versions (3.12+) and common platforms (x86_64, arm64, macOS, Linux, Windows). Active maintenance with recent release.

License in practice: License treatment is unclear; the description excerpt mentions Apache 2.0, but the metadata does not confirm this. Verify the actual license before use in proprietary or restricted contexts.

Quickstart:

pip install icechunk

import zarr
from icechunk import IcechunkStore

store = IcechunkStore(root="s3://bucket/path")
group = zarr.open_group(store=store, mode="r+")

Requires Python 3.12 or later; Zarr must be installed as a runtime dependency.

Verify before relying:

- Whether Apache 2.0 license claimed in description excerpt is formally declared in package metadata
- Specific cloud storage backends supported beyond the description's mention of GCS, Azure, and S3
- Performance characteristics and scalability limits for concurrent transactions
- Compatibility with Zarr implementations other than Zarr Python

## Package facts

- License: not declared (unclear)
- Python support: supports_current
- Install friction: medium
- Maintenance: active
- Downloads: 276.0K/month (top 15,000 on PyPI)
- Known vulnerabilities: none known

## Tags

zarr transactional storage, cloud tensor storage engine, multi-process array database, zarr cloud object storage, consistent array versioning, distributed tensor storage, zarr transaction isolation, tensor-storage, cloud-native, version-control

[View on SkillFed](https://skillfed.io/packages/icechunk) · [View on PyPI](https://pypi.org/project/icechunk/)