{"categories":[{"label":"Software Development","url":"https://skillfed.io/packages/category/software-development/6"}],"enrichment":{"capability":"Automatically captures pipeline lineage, task metadata, and run history from Apache Airflow DAGs and sends them to DataHub without requiring manual instrumentation.","skillfed_tags":["airflow-integration","data-lineage","metadata-management"],"use_cases":["Automatically track dataset and column-level lineage from SQL-based Airflow tasks into a centralized DataHub catalog","Monitor Airflow task execution status and duration to correlate failures with downstream data quality issues","Enhance OpenLineage metadata with DataHub's advanced SQL parsing for more detailed lineage than standard extractors provide","Stream Airflow pipeline metadata to Kafka for real-time consumption by other data governance tools","Resolve temporary tables across multi-statement SQL tasks to capture complete lineage in complex ETL workflows"],"what_it_does":"This package is a plugin for Apache Airflow that automatically extracts and forwards pipeline metadata to DataHub. It captures DAG structure, task inputs and outputs, and execution history without requiring code changes to your existing DAGs. The plugin integrates with Airflow's OpenLineage framework and enhances it with DataHub's SQL parser to extract column-level lineage from SQL operators, providing richer metadata than standard OpenLineage extractors alone.\n\nThe plugin supports multiple emission paths (REST, Kafka, or file) and activates automatically once configured in Airflow's configuration file with a DataHub connection. It's designed for teams running Airflow who want centralized visibility into data pipelines and lineage without manual instrumentation, making it useful for data governance, impact analysis, and compliance tracking.","worth_installing":"Yes, if you run Apache Airflow 3.0+ and use DataHub for metadata management. The plugin is actively maintained, has no known vulnerabilities, low install friction, and solves the common problem of capturing lineage from Airflow without manual instrumentation. The permissive Apache-2.0 license poses no restrictions. Install only if you have a DataHub instance to send metadata to; it is not useful standalone."},"id":"acryl-datahub-airflow-plugin","links":{"html":"https://skillfed.io/packages/acryl-datahub-airflow-plugin","md":"https://skillfed.io/packages/acryl-datahub-airflow-plugin.md","pypi":"https://pypi.org/project/acryl-datahub-airflow-plugin/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-11","license_spdx":null,"license_treatment":"permissive","name":"acryl-datahub-airflow-plugin","python_support":"supports_current","summary":"DataHub Airflow plugin \u2014 automatically capture pipeline lineage, run history, and task metadata from Apache Airflow"},"popularity":{"monthly_downloads":771401,"position":5101,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"1.7.0.3"}