apache-airflow-providers-openlineage

What it is and what it does

This package bridges Apache Airflow and OpenLineage, an open framework for collecting data lineage metadata. It acts as a provider plugin that hooks into Airflow's task execution to capture and emit lineage events—recording which datasets are read, written, and transformed by your workflows. The integration depends on apache-airflow, openlineage-python, and several common Airflow provider libraries to extract lineage from standard operators and send it to an OpenLineage-compatible backend.

You install it alongside an existing Airflow deployment to enable automatic lineage tracking without rewriting your DAGs. It supports Python 3.10 through 3.14 and is actively maintained by the Apache Airflow project. Configuration is typically done through Airflow's standard config mechanisms, and optional sqlalchemy support is available for enhanced SQL-based lineage extraction.

Use it for:

• Track data lineage across multi-step ETL pipelines to understand which datasets feed into analytics or reporting systems.
• Audit data provenance and compliance by recording the full chain of transformations from source to final output.
• Debug data quality issues by visualizing which upstream tasks and datasets contributed to a failed or incorrect result.
• Integrate Airflow lineage with a centralized metadata catalog (e.g., Marquez) for organization-wide data governance.
• Monitor data dependencies and impact analysis when planning schema changes or deprecating datasets.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Integrates Apache Airflow with OpenLineage to collect and emit data lineage metadata from Airflow workflows, enabling tracking of data flow and dependencies across your data pipeline.

Yes. This is a production-stable, actively maintained provider package from the Apache Airflow project with no known vulnerabilities. Install it if you run Airflow and need to emit lineage metadata to OpenLineage—it integrates cleanly with standard Airflow deployments and carries a permissive license. The main prerequisite is having Airflow >=2.11.0 and an OpenLineage backend configured.

Install

apache-airflow-providers-openlineage on PyPI

pip install apache-airflow-providers-openlineage

uv add apache-airflow-providers-openlineage

poetry add apache-airflow-providers-openlineage

Installing apache-airflow-providers-openlineage

Before you install

Low friction installation as a pure Python wheel. Actively maintained with a recent release; the parent Apache Airflow project has strong community backing. Requires Apache Airflow >=2.11.0 and several common-provider dependencies, all standard in Airflow ecosystems.

License in practice

Licensed under Apache-2.0 (permissive), so you can use, modify, and distribute this package freely in commercial and open-source projects without copyleft obligations.

Quickstart

pip install apache-airflow-providers-openlineage

from airflow.providers.openlineage.extractors import DefaultExtractor
from airflow import DAG

# OpenLineage integration is configured via Airflow's provider hooks

Requires Apache Airflow >=2.11.0 and Python >=3.10; OpenLineage backend configuration (e.g., endpoint URL) must be set in Airflow config or environment.

Verify before relying

• Whether the package auto-discovers and instruments existing Airflow operators or requires explicit configuration per task.
• What OpenLineage backends (e.g., Marquez, custom HTTP endpoints) are supported out of the box.
• Whether sqlalchemy optional dependency is required for SQL-based lineage extraction or only for specific operators.

Package facts

Evidence: apache_airflow_providers_openlineage-2.20.0-py3-none-any.whl

Keywords: airflow-provider, openlineage, airflow, integration

Tags

More Monitoring packages