dvc-data
DVC's data management subsystem
Decision gist · record as of 2026-08-14
Yes, if you are building on top of DVC or need hash-based file verification and content-addressed storage abstractions. The package is actively maintained, has low install friction, and carries no known vulnerabilities. However, it is marked Beta, so APIs may shift; verify compatibility with your DVC version before depending on it in production.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires Python 3.9 or later; dvc-objects must be installed as a runtime dependency.
- Low install friction with a pure-Python wheel and active maintenance; last commit 2026-08-10 with 168 days since release.
- Ten runtime dependencies are all established packages.
License · maintenance · safety
Apache-2.0 (permissive) — Apache 2.0 permissive license allows use in most commercial and open-source projects without significant restrictions.
last release 2026-02-27 (168 days) · last repo commit 2026-08-10 · 18 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 2,107,583 downloads/mo, #3,291 on PyPI
Alternatives
Verify before relying
pip install dvc-data
from dvc_data.hashfile import HashFile, HashFileDB
from dvc_data.index import DataIndex, DataIndexEntry
index = DataIndex()
index[("foo",)] = DataIndexEntry(hash_info=hash_info, meta=meta)- Whether HashFile and HashFileDB are stable APIs or still subject to breaking changes given Beta status
- Performance characteristics and scalability limits for large indexes or storage backends
- Compatibility guarantees with specific versions of dvc-objects and fsspec
What it is and what it does
dvc-data is DVC's data management subsystem, providing the core abstractions for storing, indexing, and verifying data files. It implements hash-based file objects (HashFile) similar to Git's object model, object databases (HashFileDB) that verify contents by hash, and a trie-like index structure (DataIndex) that maps file paths to metadata and storage locations. The package abstracts storage backends through pluggable ObjectStorage and FileStorage implementations, allowing DVC to work with different underlying filesystems via fsspec.
The library is designed as a low-level building block for data pipeline tools. It handles the mechanics of content-addressed storage—storing files by their hash digest and verifying integrity—while remaining agnostic about where or how data is actually persisted. Developers typically use it indirectly through DVC itself, though it can be imported directly for custom data management workflows.
Use it for
- Building data pipelines that need to verify file integrity using hash-based content addressing
- Implementing custom data storage backends that integrate with DVC workflows
- Creating reproducible data indexes that track file metadata and storage locations
- Developing tools that require trie-based hierarchical data organization with hash verification
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you are building on top of DVC or need hash-based file verification and content-addressed storage abstractions.
The package is actively maintained, has low install friction, and carries no known vulnerabilities. However, it is marked Beta, so APIs may shift; verify compatibility with your DVC version before depending on it in production.
Install
dvc-data on PyPI
Before you install
Low install friction with a pure-Python wheel and active maintenance; last commit 2026-08-10 with 168 days since release. Ten runtime dependencies are all established packages.
Requires Python 3.9 or later; dvc-objects must be installed as a runtime dependency.
License in practice
Apache 2.0 permissive license allows use in most commercial and open-source projects without significant restrictions.
Quickstart
pip install dvc-data
from dvc_data.hashfile import HashFile, HashFileDB
from dvc_data.index import DataIndex, DataIndexEntry
index = DataIndex()
index[("foo",)] = DataIndexEntry(hash_info=hash_info, meta=meta)Verify before relying
- Whether HashFile and HashFileDB are stable APIs or still subject to breaking changes given Beta status
- Performance characteristics and scalability limits for large indexes or storage backends
- Compatibility guarantees with specific versions of dvc-objects and fsspec
Package facts
| License | Apache-2.0 permissive |
| Python support | Supports the current Python release >=3.9 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 10 packagesattrsdictdifferdiskcachedvc-objectsfsspecfuncypygtriesqltrietqdmorjson |
| Maintenance | Actively maintained 168 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 2,107,583 / month, #3,291 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Development Status :: 4 - BetaProgramming Language :: Python :: 3Programming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Programming Language :: Python :: 3.13Programming Language :: Python :: 3.14Programming Language :: Python :: 3.9 |
Evidence: dvc_data-3.18.3-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “dvc data management”
- dvc-dataProvides data storage and indexing abstractions for DVC, including…
- dvc-s3Enables DVC to read from, write to, and manage data on Amazon S3 as a…
- dvc-studio-clientClient library for posting experiment metrics, model registry data,…
Give your agent the search over MCP, or paste the wish link into any chat.
More Database packages
psycopg2-binary is a PostgreSQL database adapter for Python that implements the DB API 2.0 specification, enabling Python applications to connect to and query PostgreSQL databases with thread-safe concurrent operations.
Python client library for connecting to and executing commands against Redis key-value stores, supporting both synchronous and asynchronous operations.
Install it if your application needs to interact with Redis; the only prerequisite is a running Redis server instance.
YDB Python SDK is the official client library for connecting to and querying YDB databases from Python applications.
Install it if you need to connect Python applications to YDB databases.
Connects Python applications to Snowflake data warehouses using the DB API 2.0 specification, enabling SQL queries, data transfers, and warehouse operations.
sqlparse tokenizes SQL text into a tree of statements, clauses, and expressions, and provides functions to split scripts, format queries, and inspect parsed tokens without validating dialect or syntax.
Install it if you need to manipulate, format, or analyze SQL text programmatically.
Provides base adapter protocols and shared functionality that database adapters use to integrate with dbt-core, handling connections, dialect translation, relation caching, and core interface management.
See also dvc-objects · dvc-http · dvc-studio-client · sqltrie · dvc-render · dvc-gdrive · dvc-ssh · dirhash · dvc-s3 · dvc