tensorflow-data-validation
A library for exploring and validating machine learning data.
Decision gist · record as of 2026-08-14
Yes, if you are building machine learning pipelines with TensorFlow or TFX and need automated data validation and schema management. The active maintenance, permissive license, and integration with the TFX ecosystem make it a solid choice. Medium install friction is acceptable given the value for data quality assurance in ML workflows.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires TensorFlow, Apache Beam, and PyArrow; medium install friction on systems without prebuilt wheels or with missing system libraries.
- Medium install friction due to 12 runtime dependencies including TensorFlow, Apache Beam, and PyArrow.
- Package is actively maintained with recent releases and prebuilt wheels for Python 3.10–3.13 on macOS and Linux.
License · maintenance · safety
Apache 2.0 (permissive) — Licensed under Apache 2.0 (permissive), allowing commercial and private use with minimal restrictions.
last release 2026-06-11 (64 days) · last repo commit 2026-08-14 · 783 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 89,668 downloads/mo, #13,641 on PyPI
Alternatives
Verify before relying
pip install tensorflow-data-validation
import tensorflow_data_validation as tfdv
stats = tfdv.generate_statistics_from_csv('data.csv')
schema = tfdv.infer_schema(stats)- Whether the package's distributed computation via Apache Beam is production-ready for datasets larger than memory on your infrastructure.
- Performance characteristics and scalability limits for real-world data volumes in your use case.
What it is and what it does
TensorFlow Data Validation is a library for exploring, profiling, and validating machine learning datasets at scale. It integrates with TensorFlow and TensorFlow Extended (TFX) to provide automated data quality checks before model training. The package computes summary statistics on training and test data, generates data schemas that describe expectations (required values, ranges, vocabularies), and detects anomalies such as missing features, out-of-range values, or incorrect types.
Under the hood, TFDV uses Apache Beam for distributed computation and Apache Arrow for vectorized in-memory data representation. It includes viewers for inspecting data distributions, comparing feature pairs, and examining detected anomalies. The package is designed for scalability and works well in both local and distributed environments (e.g., Google Cloud Dataflow).
Use it for
- Generate baseline statistics and schemas from training data, then detect data drift or anomalies in production pipelines.
- Validate incoming datasets before feeding them into TensorFlow models to catch data quality issues early.
- Automatically infer feature schemas and data types from raw CSV or Arrow data to bootstrap data validation rules.
- Compare training and test data distributions to identify potential train-test skew or data quality problems.
- Build data quality gates in TFX pipelines to enforce schema compliance and flag unexpected feature patterns.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you are building machine learning pipelines with TensorFlow or TFX and need automated data validation and schema management.
The active maintenance, permissive license, and integration with the TFX ecosystem make it a solid choice. Medium install friction is acceptable given the value for data quality assurance in ML workflows.
Install
tensorflow-data-validation on PyPI
Before you install
Medium install friction due to 12 runtime dependencies including TensorFlow, Apache Beam, and PyArrow. Package is actively maintained with recent releases and prebuilt wheels for Python 3.10–3.13 on macOS and Linux.
Requires TensorFlow, Apache Beam, and PyArrow; medium install friction on systems without prebuilt wheels or with missing system libraries.
License in practice
Licensed under Apache 2.0 (permissive), allowing commercial and private use with minimal restrictions.
Quickstart
pip install tensorflow-data-validation
import tensorflow_data_validation as tfdv
stats = tfdv.generate_statistics_from_csv('data.csv')
schema = tfdv.infer_schema(stats)Verify before relying
- Whether the package's distributed computation via Apache Beam is production-ready for datasets larger than memory on your infrastructure.
- Performance characteristics and scalability limits for real-world data volumes in your use case.
Package facts
| License | Apache 2.0 permissive |
| Python support | Supports the current Python release <4,>=3.10 |
| Install friction | Medium. Platform-specific wheel |
| Runtime dependencies | 12 packagesabsl-pyapache-beamjoblibnumpypandasprotobufpyarrowpyfarmhashsixtensorflowtensorflow-metadatatfx-bsl |
| Maintenance | Actively maintained 64 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 89,668 / month, #13,641 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Development Status :: 5 - Production/StableIntended Audience :: DevelopersIntended Audience :: EducationIntended Audience :: Science/ResearchLicense :: OSI Approved :: Apache Software LicenseOperating System :: MacOS :: MacOS XOperating System :: POSIX :: LinuxProgramming Language :: PythonProgramming Language :: Python :: 3Programming Language :: Python :: 3 :: OnlyProgramming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Programming Language :: Python :: 3.13Topic :: Scientific/EngineeringTopic :: Scientific/Engineering :: Artificial IntelligenceTopic :: Scientific/Engineering :: MathematicsTopic :: Software DevelopmentTopic :: Software Development :: LibrariesTopic :: Software Development :: Libraries :: Python Modules |
Evidence: tensorflow_data_validation-1.21.0-cp310-cp310-macosx_11_0_arm64.whl; tensorflow_data_validation-1.21.0-cp310-cp310-manylinux_2_39_x86_64.whl; tensorflow_data_validation-1.21.0-cp311-cp311-macosx_11_0_arm64.whl; tensorflow_data_validation-1.21.0-cp311-cp311-manylinux_2_39_x86_64.whl; tensorflow_data_validation-1.21.0-cp312-cp312-macosx_11_0_arm64.whl; tensorflow_data_validation-1.21.0-cp312-cp312-manylinux_2_39_x86_64.whl; tensorflow_data_validation-1.21.0-cp313-cp313-macosx_11_0_arm64.whl; tensorflow_data_validation-1.21.0-cp313-cp313-manylinux_2_39_x86_64.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “ml data validation”
- tensorflow-data-validationTensorFlow Data Validation (TFDV) computes summary statistics,…
- evidentlyEvidently evaluates, tests, and monitors ML and LLM systems through…
- taktile-authProvides authentication and authorization services for the Taktile ML…
Give your agent the search over MCP, or paste the wish link into any chat.
More Software Development packages
Provides backported and experimental type hints for Python 3.9+, allowing use of newer typing features on older Python versions and enabling early experimentation with type system PEPs before they enter the standard library.
NumPy provides an N-dimensional array object and a comprehensive suite of mathematical, linear algebra, Fourier transform, and random number functions for scientific computing in Python.
FastAPI is a Python web framework for building REST APIs using type hints, with automatic request validation, serialization, and interactive API documentation.
Provides a way to document function parameters, class attributes, return types, and variables inline using Python's `Annotated` type hint syntax instead of traditional docstrings.
Typer builds command-line applications from Python functions using type hints, automatically generating help text, argument parsing, and shell completion.
Install it if you are building CLIs in Python.
Distlib provides low-level packaging utilities for building, distributing, and managing Python software—including metadata handling, version specifiers, wheel support, script installation, and dependency resolution.
See also tensorflow-metadata · tensorflow-transform · tfx-bsl · tfp-nightly · tensorboard-data-server · tensorflow-io · tensorboard · tfds-nightly · tensorflow-probability · tensorflow-datasets