{"categories":[{"label":"Software Development","url":"https://skillfed.io/packages/category/software-development/3"}],"enrichment":{"capability":"DataHub's ingestion framework and CLI for pulling metadata from 50+ data sources (Snowflake, BigQuery, dbt, Looker, Airflow, and others) into a centralized catalog, or pushing metadata programmatically from your own applications.","skillfed_tags":["metadata-catalog","data-governance","lineage-tracking"],"use_cases":["Schedule automated metadata extraction from Snowflake, BigQuery, or Redshift warehouses on a daily or hourly cadence via YAML recipe.","Emit dataset lineage and ownership metadata directly from a Python data pipeline or Spark job as it executes.","Transform and filter metadata in transit using built-in transformers before ingestion into the catalog.","Integrate dbt, Looker, or Airflow metadata into a centralized DataHub instance for cross-tool lineage visibility.","Query and search the DataHub catalog programmatically or via CLI to find datasets, owners, and documentation."],"what_it_does":"Acryl-datahub is DataHub's official ingestion framework and command-line tool for metadata management. It bridges your data infrastructure and a centralized metadata catalog by supporting both pull-based connectors (scheduled crawls of databases, warehouses, BI tools, and orchestrators) and push-based APIs (programmatic metadata emission from applications and data pipelines). The package includes 50+ ready-made source connectors, built-in metadata transformers, and a Python SDK for direct integration.\n\nYou use it either as a CLI tool with YAML recipe files for scheduled batch ingestion in CI/CD pipelines, or as a Python library to emit metadata events directly from your code as data flows through your systems. It automates the capture and propagation of lineage, ownership, tags, and documentation across your data assets, feeding them into a DataHub instance for discovery and governance.","worth_installing":"Yes. The package is actively maintained, has low install friction, carries no known vulnerabilities, and is licensed permissively. Install it if you need to ingest metadata from multiple data sources into DataHub or emit metadata from your own applications. It is the canonical way to connect external data systems to DataHub and is suitable for production use."},"id":"acryl-datahub","links":{"html":"https://skillfed.io/packages/acryl-datahub","md":"https://skillfed.io/packages/acryl-datahub.md","pypi":"https://pypi.org/project/acryl-datahub/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-11","license_spdx":"Apache-2.0","license_treatment":"permissive","name":"acryl-datahub","python_support":"supports_current","summary":"DataHub ingestion framework and CLI \u2014 connect, extract, and push metadata from 50+ data sources into your DataHub catalog"},"popularity":{"monthly_downloads":4304751,"position":2338,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"1.7.0.3"}