{"categories":[{"label":"Database","url":"https://skillfed.io/packages/category/database/2"}],"enrichment":{"capability":"Provides data storage and indexing abstractions for DVC, including hash-based file verification, object databases, and trie-like data indexes with pluggable storage backends.","skillfed_tags":["content-addressed-storage","data-indexing","dvc-ecosystem"],"use_cases":["Building data pipelines that need to verify file integrity using hash-based content addressing","Implementing custom data storage backends that integrate with DVC workflows","Creating reproducible data indexes that track file metadata and storage locations","Developing tools that require trie-based hierarchical data organization with hash verification"],"what_it_does":"dvc-data is DVC's data management subsystem, providing the core abstractions for storing, indexing, and verifying data files. It implements hash-based file objects (HashFile) similar to Git's object model, object databases (HashFileDB) that verify contents by hash, and a trie-like index structure (DataIndex) that maps file paths to metadata and storage locations. The package abstracts storage backends through pluggable ObjectStorage and FileStorage implementations, allowing DVC to work with different underlying filesystems via fsspec.\n\nThe library is designed as a low-level building block for data pipeline tools. It handles the mechanics of content-addressed storage\u2014storing files by their hash digest and verifying integrity\u2014while remaining agnostic about where or how data is actually persisted. Developers typically use it indirectly through DVC itself, though it can be imported directly for custom data management workflows.","worth_installing":"Yes, if you are building on top of DVC or need hash-based file verification and content-addressed storage abstractions. The package is actively maintained, has low install friction, and carries no known vulnerabilities. However, it is marked Beta, so APIs may shift; verify compatibility with your DVC version before depending on it in production."},"id":"dvc-data","links":{"html":"https://skillfed.io/packages/dvc-data","md":"https://skillfed.io/packages/dvc-data.md","pypi":"https://pypi.org/project/dvc-data/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-02-27","license_spdx":"Apache-2.0","license_treatment":"permissive","name":"dvc-data","python_support":"supports_current","summary":"DVC's data management subsystem"},"popularity":{"monthly_downloads":2107583,"position":3291,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"3.18.3"}