--- id: apache-airflow-providers-openlineage version: "2.20.0" license: Apache-2.0 license_treatment: permissive maintenance: active --- # apache-airflow-providers-openlineage — Provider package apache-airflow-providers-openlineage for Apache Airflow License: permissive · Maintenance: active · Downloads: 2.2M/mo ## What it is and what it does This package bridges Apache Airflow and OpenLineage, an open framework for collecting data lineage metadata. It acts as a provider plugin that hooks into Airflow's task execution to capture and emit lineage events—recording which datasets are read, written, and transformed by your workflows. The integration depends on apache-airflow, openlineage-python, and several common Airflow provider libraries to extract lineage from standard operators and send it to an OpenLineage-compatible backend. You install it alongside an existing Airflow deployment to enable automatic lineage tracking without rewriting your DAGs. It supports Python 3.10 through 3.14 and is actively maintained by the Apache Airflow project. Configuration is typically done through Airflow's standard config mechanisms, and optional sqlalchemy support is available for enhanced SQL-based lineage extraction. Use it for: - Track data lineage across multi-step ETL pipelines to understand which datasets feed into analytics or reporting systems. - Audit data provenance and compliance by recording the full chain of transformations from source to final output. - Debug data quality issues by visualizing which upstream tasks and datasets contributed to a failed or incorrect result. - Integrate Airflow lineage with a centralized metadata catalog (e.g., Marquez) for organization-wide data governance. - Monitor data dependencies and impact analysis when planning schema changes or deprecating datasets. ## Worth the install? AI-flagged interpretation of the facts above — verify before relying. Integrates Apache Airflow with OpenLineage to collect and emit data lineage metadata from Airflow workflows, enabling tracking of data flow and dependencies across your data pipeline. Yes. This is a production-stable, actively maintained provider package from the Apache Airflow project with no known vulnerabilities. Install it if you run Airflow and need to emit lineage metadata to OpenLineage—it integrates cleanly with standard Airflow deployments and carries a permissive license. The main prerequisite is having Airflow >=2.11.0 and an OpenLineage backend configured. ## Install pip install apache-airflow-providers-openlineage uv add apache-airflow-providers-openlineage poetry add apache-airflow-providers-openlineage ## Installing apache-airflow-providers-openlineage Before you install: Low friction installation as a pure Python wheel. Actively maintained with a recent release; the parent Apache Airflow project has strong community backing. Requires Apache Airflow >=2.11.0 and several common-provider dependencies, all standard in Airflow ecosystems. License in practice: Licensed under Apache-2.0 (permissive), so you can use, modify, and distribute this package freely in commercial and open-source projects without copyleft obligations. Quickstart: pip install apache-airflow-providers-openlineage from airflow.providers.openlineage.extractors import DefaultExtractor from airflow import DAG # OpenLineage integration is configured via Airflow's provider hooks Requires Apache Airflow >=2.11.0 and Python >=3.10; OpenLineage backend configuration (e.g., endpoint URL) must be set in Airflow config or environment. Verify before relying: - Whether the package auto-discovers and instruments existing Airflow operators or requires explicit configuration per task. - What OpenLineage backends (e.g., Marquez, custom HTTP endpoints) are supported out of the box. - Whether sqlalchemy optional dependency is required for SQL-based lineage extraction or only for specific operators. ## Package facts - License: Apache-2.0 (permissive) - Python support: supports_current - Install friction: low - Maintenance: active - Downloads: 2.2M/month (top 5,000 on PyPI) - Known vulnerabilities: none known ## Tags airflow data lineage tracking, openlineage airflow integration, airflow metadata collection, data lineage airflow provider, airflow workflow lineage, openlineage provider airflow, airflow data provenance, airflow-provider, data-lineage, metadata-collection [View on SkillFed](https://skillfed.io/packages/apache-airflow-providers-openlineage) · [View on PyPI](https://pypi.org/project/apache-airflow-providers-openlineage/)