chispa
Pyspark test helper library
Decision gist · record as of 2026-08-14
Yes. Chispa is a lightweight, actively maintained testing utility with no security issues and low install friction. It directly addresses the pain point of making test failures readable and actionable. Install it as a development dependency if you write tests.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires a working Spark environment; not declared as a runtime dependency but is the package's primary use case.
- Low friction install with a single runtime dependency (prettytable).
- Actively maintained with recent releases and no known vulnerabilities.
License · maintenance · safety
MIT (permissive) — MIT license permits unrestricted use, modification, and distribution in both open-source and commercial projects.
last release 2026-03-24 (143 days) · last repo commit 2026-08-09 · 774 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 3,041,738 downloads/mo, #2,777 on PyPI
Alternatives
Verify before relying
pip install chispa
from chispa.column_comparer import assert_column_equality
assert_column_equality(df, "actual_column", "expected_column")- Whether Spark is an implicit dependency or must be installed separately.
- Performance characteristics when comparing very large DataFrames.
- Full list of assertion methods beyond column and DataFrame equality.
What it is and what it does
Chispa is a testing library that simplifies writing unit tests by providing assertion methods like `assert_column_equality` and `assert_df_equality` that compare data structures while generating human-readable error messages that highlight mismatches. When a test fails, the output uses color-coding and formatted tables to show exactly which rows or values differ, making debugging much faster than reading raw error output.
The library supports flexible comparison modes: you can ignore row order, column order, specific columns, nullable schema properties, and NaN equality. It integrates with pytest and is designed as a development dependency. The package is actively maintained, supports Python 3.10, 3.11, and 3.12, and carries no known security vulnerabilities.
Use it for
- Write unit tests with clear assertion failures and readable error output.
- Compare actual and expected data structures while ignoring row or column order.
- Debug data quality issues by viewing formatted side-by-side comparisons of mismatched rows.
- Test column-level transformations with descriptive failure messages.
- Validate schema changes while ignoring nullable property differences.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes.
Chispa is a lightweight, actively maintained testing utility with no security issues and low install friction. It directly addresses the pain point of making test failures readable and actionable. Install it as a development dependency if you write tests.
Install
chispa on PyPI
Before you install
Low friction install with a single runtime dependency (prettytable). Actively maintained with recent releases and no known vulnerabilities.
Requires a working Spark environment; not declared as a runtime dependency but is the package's primary use case.
License in practice
MIT license permits unrestricted use, modification, and distribution in both open-source and commercial projects.
Quickstart
pip install chispa
from chispa.column_comparer import assert_column_equality
assert_column_equality(df, "actual_column", "expected_column")Verify before relying
- Whether Spark is an implicit dependency or must be installed separately.
- Performance characteristics when comparing very large DataFrames.
- Full list of assertion methods beyond column and DataFrame equality.
Package facts
| License | MIT permissive |
| Python support | Supports the current Python release <4.0,>=3.10 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 1 packageprettytable |
| Maintenance | Actively maintained 143 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 3,041,738 / month, #2,777 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Development Status :: 3 - AlphaEnvironment :: ConsoleFramework :: PytestIntended Audience :: DevelopersLicense :: OSI Approved :: MIT LicenseOperating System :: OS IndependentProgramming Language :: PythonProgramming Language :: Python :: 3Programming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Topic :: Software Development :: Libraries :: Python ModulesTopic :: Software Development :: Quality AssuranceTopic :: Software Development :: Testing |
Evidence: chispa-0.12.0-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “spark test assertions”
- chispaProvides assertion methods for testing PySpark code with descriptive…
- surerSurer provides fluent, RSpec-inspired assertion syntax for Python…
- assertpyProvides a fluent assertion API for writing readable unit test…
Give your agent the search over MCP, or paste the wish link into any chat.
More Python Modules packages
Converts domain names between Unicode and ASCII-compatible encoding (Punycode) according to IDNA 2008 and Unicode Technical Standard 46, with security validation and broader script coverage than the standard library.
Install it if you work with internationalized domain names, need to validate domains, or use HTTP clients that depend on it transitively.
Setuptools is a Python build backend and package management tool that handles building, distributing, and installing Python packages, including support for C/C++ extension modules.
PyYAML parses and emits YAML 1.1 data format, enabling serialization and deserialization of configuration files and Python objects to and from human-readable YAML text.
Pydantic validates Python data structures against type hints, coercing and checking input at runtime to ensure it matches a declared schema.
Provides reusable metadata objects for use with PEP-593 `typing.Annotated` to express common constraints like bounds, collection sizes, and predicates on types.
Install it if you use or build libraries that need to express type constraints in a standardized, inspectable way—or if you want to annotate your own types with…
Provides runtime tools to inspect and introspect Python type annotations, enabling programmatic examination of type hints at execution time.
See also pyspark-test · quinn · databricks-test · cuallee · sparkaid · datacompy · dbldatagen · sparkdantic