skillfed

airflow-provider-great-expectations

An Apache Airflow provider for Great Expectations

airflow-provider-great-expectations v1.0.0 179.6K downloads/30d#10,167 on PyPI174
Permissive license Apache-2.0 Active released

What it is and what it does

This package bridges Apache Airflow and Great Expectations by providing Airflow operators that wrap Great Expectations validation logic. It lets you embed data quality checks directly into Airflow DAGs, so data validation becomes a native task type rather than a custom Python wrapper. The operators accept Great Expectations checkpoints and run them as part of your orchestrated workflows.

The package is in Alpha status but actively maintained, with support for Python 3.10 through 3.13. It depends on both Apache Airflow and Great Expectations, so you need both frameworks already set up. The integration is designed to be straightforward for teams already using Airflow who want to add Great Expectations validation without building custom operators.

Use it for:

  • Add data quality gates to Airflow pipelines before downstream processing or loading.
  • Run Great Expectations checkpoints on a schedule as part of your DAG orchestration.
  • Validate data at multiple stages in a multi-step ETL workflow within a single DAG.
  • Integrate data quality monitoring into existing Airflow infrastructure without custom code.
  • Fail or branch DAG execution based on Great Expectations validation results.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Provides Apache Airflow operators that integrate Great Expectations data validation into Airflow workflows, allowing you to define and run data quality tests as part of your DAGs.

Yes, if you use both Apache Airflow and Great Expectations. The low install friction, active maintenance, permissive license, and zero known vulnerabilities make it a safe choice. The Alpha status means the API may change, but the package is actively developed and suitable for production use in teams already committed to both frameworks.

Install

airflow-provider-great-expectations on PyPI

pip

pip install airflow-provider-great-expectations

uv

uv add airflow-provider-great-expectations

poetry

poetry add airflow-provider-great-expectations

Installing airflow-provider-great-expectations

Before you install

Low friction install with a pure-Python wheel. Actively maintained as of 2026-01-28, with recent commits and no archived status. Requires Apache Airflow and Great Expectations as runtime dependencies.

License in practice

Apache-2.0 permissive license allows commercial and private use with minimal restrictions, typical for Airflow ecosystem packages.

Quickstart

pip install airflow-provider-great-expectations

from airflow_provider_great_expectations.operators import GreatExpectationsOperator

task = GreatExpectationsOperator(
    task_id='validate_data',
    checkpoint_name='my_checkpoint'
)

Requires Apache Airflow and Great Expectations to be installed and configured; Airflow DAG context needed to run operators.

Verify before relying

  • Specific operator types and their parameters beyond the basic checkpoint-based pattern.
  • Whether the package supports all Great Expectations checkpoint features or has limitations.
  • Integration patterns with different Airflow versions and Great Expectations versions.

Package facts

License Apache-2.0 (permissive)
Python support supports the current Python release (<3.14,>3.9)
Install friction low — pure-Python wheel
Runtime dependencies 3 — apache-airflow, great-expectations, structlog
Maintenance actively maintained — 198 days since the last release
Last repo commit
First released
Downloads 179,621/month — #10,167 on PyPI (30-day window, as of 2026-08-14)
Known vulnerabilities none known (OSV.dev, checked 2026-08-14)

Evidence: airflow_provider_great_expectations-1.0.0-py3-none-any.whl

Keywords: airflow, great expectations, provider

Development Status :: 3 - AlphaEnvironment :: Web EnvironmentFramework :: Apache AirflowFramework :: Apache Airflow :: ProviderIntended Audience :: DevelopersLicense :: OSI Approved :: Apache Software LicenseOperating System :: OS IndependentProgramming Language :: PythonProgramming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Programming Language :: Python :: 3.13

Tags

airflow data validation operatorsgreat expectations airflow integrationdata quality testing in airflowairflow data quality checksgreat expectations providerairflow data validation tasksdata testing workflows
airflow-providerdata-validationorchestration

More Quality Assurance packages

coverage

Coverage.py measures which lines of Python code…

permissive · top 1,000 on PyPI

ruff

Ruff is a Python linter and code formatter…

permissive · top 1,000 on PyPI

pexpect

Pexpect spawns and controls interactive console…

permissive · top 1,000 on PyPI

black

Black reformats Python source code to a…

permissive · top 1,000 on PyPI

pytest-xdist

pytest-xdist distributes pytest tests across…

permissive · top 1,000 on PyPI

cfn-lint

Validates AWS CloudFormation templates in YAML…

permissive · top 1,000 on PyPI

apache-airflow-providers-openai

Integrates OpenAI APIs into Apache Airflow…

permissive · top 15,000 on PyPI

apache-airflow-providers-anomalo

Provides native Apache Airflow operators and…

permissive · top 15,000 on PyPI

apache-airflow-providers-informatica

Provides Apache Airflow integration operators…

permissive · top 15,000 on PyPI

great-expectations

Defines and validates data quality…

permissive · top 1,000 on PyPI

great-expectations-experimental

Experimental extensions and early-stage…

permissive · top 15,000 on PyPI

apache-airflow-providers-standard

Provides standard operators, hooks, and sensors…

permissive · top 5,000 on PyPI

apache-airflow-providers-zendesk

Provides operators and hooks to integrate…

permissive · top 15,000 on PyPI

apache-airflow-providers-tableau

Integrates Tableau with Apache Airflow,…

permissive · top 5,000 on PyPI

apache-airflow-providers-elasticsearch

Integrates Elasticsearch with Apache Airflow,…

permissive · top 15,000 on PyPI

apache-airflow-providers-weaviate

Integrates Weaviate vector database operations…

permissive · top 15,000 on PyPI