quinn
Pyspark helper methods to maximize developer efficiency
What it is and what it does
Quinn is a utility library providing convenience functions for common DataFrame operations in Spark workflows. It offers DataFrame validation functions (checking column presence, schema conformance, column absence), column-level transformations (string cleaning, whitespace handling, pattern extraction, date calculations), and DataFrame utilities (converting columns to lists or dictionaries, parsing output strings back into DataFrames). The library also includes schema helpers for loading schemas from CSV files and printing schemas as code, plus transformations like converting column names to snake_case and sorting columns alphabetically.
With no external runtime dependencies and support for Python 3.7 through 3.11, Quinn integrates directly into existing workflows. It targets developer productivity by offering pre-built solutions for frequent data cleaning and validation tasks that would otherwise require repetitive boilerplate code.
Use it for:
- Validate that required columns exist in a DataFrame before processing to catch schema mismatches early.
- Clean and normalize string columns by removing extra whitespace, non-word characters, or applying regex patterns.
- Convert DataFrame columns to Python data structures (lists, dictionaries) for downstream processing or export.
- Standardize DataFrame column naming conventions across a project by converting to snake_case.
- Load and manage schemas from CSV files instead of defining them programmatically.
- Sort DataFrame columns alphabetically to improve navigation of wide DataFrames.
Worth the install?
AI-flagged interpretation of the facts on this page — verify before relying
Quinn provides helper methods for PySpark DataFrame validation, column transformations, and data manipulation to reduce boilerplate in Spark applications.
Yes. Quinn is actively maintained, has no external dependencies, carries a permissive Apache-2.0 license, and provides genuine convenience for common DataFrame tasks. It's well-suited for teams standardizing validation and transformation patterns. Install it if your workflows involve frequent data cleaning, validation, or schema management.
Install
quinn on PyPI
pip
pip install quinnuv
uv add quinnpoetry
poetry add quinnInstalling quinn
Before you install
Low install friction with no runtime dependencies. Active maintenance with last commit on 2026-06-09 and 687 repository stars.
License in practice
Licensed under Apache-2.0 (permissive), allowing use in commercial and proprietary projects with minimal restrictions.
Quickstart
pip install quinn
import quinn
# Validate required columns exist
quinn.validate_presence_of_columns(source_df, ["name", "age"])
# Transform column names to snake_case
df_clean = quinn.snake_case_col_names(source_df)
# Convert column to list
values_list = quinn.column_to_list(source_df, "name")
Requires a working Spark environment; Quinn is a library of helper functions, not a standalone tool.
Verify before relying
- Performance characteristics of Quinn's transformations compared to native operations on large datasets.
- Whether helper functions are optimized for production workloads or primarily for development convenience.
- Specific compatibility with different PySpark versions beyond Python 3.7–3.11 support.
Package facts
| License | Apache-2.0 (permissive) |
| Python support | supports the current Python release (>=3.7,<4.0) |
| Install friction | low — pure-Python wheel |
| Runtime dependencies | none |
| Maintenance | actively maintained — 913 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 609,835/month — #5,769 on PyPI (30-day window, as of 2026-08-14) |
| Known vulnerabilities | none known (OSV.dev, checked 2026-08-14) |
Evidence: quinn-0.10.3-py3-none-any.whl
Keywords: apachespark, spark, pyspark
Tags
More Application Frameworks packages
FastAPI is a Python web framework for building…
permissive · top 100 on PyPI
annotated-docProvides a way to document function parameters,…
permissive · top 100 on PyPI
textualTextual is a Python framework for building…
permissive · top 100 on PyPI
typerTyper builds command-line applications from…
permissive · top 1,000 on PyPI
mcpBuild and connect to Model Context Protocol…
permissive · top 1,000 on PyPI
WerkzeugWerkzeug is a WSGI utility library providing…
permissive · top 1,000 on PyPI
sparkaidProvides utilities for working with Spark…
copyleft · top 15,000 on PyPI
spark-expectationsSpark Expectations is a data quality framework…
unclear · top 15,000 on PyPI
chispaProvides assertion methods for testing PySpark…
permissive · top 5,000 on PyPI
pyspark-testProvides a testing utility to assert equality…
permissive · top 15,000 on PyPI
cualleeCuallee provides a dataframe-agnostic API to…
permissive · top 15,000 on PyPI
tinselGenerates PySpark DataFrame schemas from Python…
permissive · top 15,000 on PyPI
sparkdanticConverts Pydantic models to PySpark schemas…
unclear · top 5,000 on PyPI
dbl-tempoTempo provides time series operations on Spark…
permissive · top 5,000 on PyPI
dbldatagenGenerates synthetic data at scale within…
unclear · top 15,000 on PyPI
schematicsSchematics defines, validates, and transforms…
permissive · top 15,000 on PyPI