{"categories":[{"label":"Database","url":"https://skillfed.io/packages/category/database/3"}],"enrichment":{"capability":"Icechunk is a transactional storage engine for tensor/ND-array data that works with Zarr to provide consistent, multi-process-safe reads and writes on cloud object storage.","skillfed_tags":["tensor-storage","cloud-native","version-control"],"use_cases":["Store and version large multidimensional datasets (e.g., climate, geospatial, or scientific simulations) on S3 or other cloud storage with transactional safety.","Enable multiple concurrent processes to read and write to the same Zarr arrays without coordination or locking.","Maintain immutable snapshots and branches of tensor data for reproducibility and time-travel debugging.","Organize related arrays into hierarchical groups with schema evolution (add, rename, remove arrays with minimal overhead).","Reference chunks from external file formats (HDF5, NetCDF) within a Zarr-compatible store."],"what_it_does":"Icechunk augments Zarr with transactional guarantees and version control for multidimensional array data stored on cloud object storage. It presents a key-value interface to Zarr while managing all I/O, enabling safe parallel reads and writes from multiple uncoordinated processes without external locks or databases. A repo is a self-contained Zarr store (typically a group with multiple related arrays) that supports snapshots, branches, tags, and time-travel access to previous versions.\n\nThe package is built on Rust bindings (PyO3) and provides serializable isolation\u2014reads always see committed snapshots, writes are atomic and never partially visible. It supports chunk sharding, chunk references to external formats like HDF5, and schema evolution. Icechunk is designed for scientific computing, data science, and AI/ML workflows where consistent, versioned tensor storage on cloud infrastructure is required.","worth_installing":"Yes, if you need transactional, multi-process-safe tensor storage on cloud object storage with Zarr. The package is actively maintained, has no known vulnerabilities, and supports current Python versions. However, verify the license treatment before use in proprietary contexts, and confirm that the Apache 2.0 license mentioned in the description is formally declared. Medium install friction is acceptable for most environments given the availability of prebuilt wheels."},"id":"icechunk","links":{"html":"https://skillfed.io/packages/icechunk","md":"https://skillfed.io/packages/icechunk.md","pypi":"https://pypi.org/project/icechunk/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-07-29","license_spdx":null,"license_treatment":"unclear","name":"icechunk","python_support":"supports_current","summary":"Icechunk Python"},"popularity":{"monthly_downloads":276005,"position":8169,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"2.1.2"}