$npx skillfedfor your agent

acryl-datahub-dagster-plugin

DataHub Dagster plugin — automatically capture asset lineage, run history, and job metadata from Dagster pipelines

With conditionsPyPI Software DevelopmentReleased Aug 2026126.8K downloads / moApache-2.0Pure Python

Decision gist · record as of 2026-08-14

pure-Python wheel — acryl_datahub_dagster_plugin-1.7.0.4-py3-none-any.whl
v1.7.0.4 · released 2026-08-14 · Python >=3.10 · 3 runtime deps: dagit, dagster, acryl-datahub

Yes—if you run Dagster and use acryl-datahub for data catalog and lineage, this plugin eliminates manual metadata instrumentation and keeps lineage synchronized automatically. Low install friction, active maintenance, no known vulnerabilities, and permissive licensing make it a straightforward addition. Install only if you have both Dagster and acryl-datahub in your stack.AI-flagged interpretation of the facts on this page — verify before relying

Before you install

  • Requires Python 3.10 or later; requires a running Dagster instance and a DataHub deployment (self-hosted or Cloud).
  • Low install friction with a pure-Python wheel.
  • Active maintenance as of 2026-08-14 with no known vulnerabilities.

License · maintenance · safety

Apache-2.0 (permissive) — Licensed under Apache-2.0 (permissive), allowing use in commercial and private projects with minimal restrictions.

last release 2026-08-14 (0 days) · last repo commit 2026-08-14 · 34 stars

0 known vulnerabilities (OSV.dev, 2026-08-14) · 126,808 downloads/mo, #11,765 on PyPI

Verify before relying

pip install acryl-datahub-dagster-plugin

from datahub.ingestion.graph.config import DatahubClientConfig
from datahub_dagster_plugin.sensors.datahub_sensors import DatahubDagsterSourceConfig, make_datahub_sensor

config = DatahubDagsterSourceConfig(
    datahub_client_config=DatahubClientConfig(server="http://localhost:8080"),
    dagster_url="http://localhost:3000",
)
datahub_sensor = make_datahub_sensor(config=config)
  • Whether the sensor handles all Dagster asset types and external dataset mappings without gaps.
  • Performance impact on Dagster job execution when the sensor is active.
  • Compatibility with specific DataHub versions or deployment configurations.
Same gist for agents: .md · .json

What it is and what it does

This package bridges Dagster and acryl-datahub by automatically extracting and forwarding pipeline metadata without manual instrumentation. It runs as a sensor that listens to job executions and captures asset definitions, upstream/downstream relationships, and run status, then pushes that lineage and metadata into acryl-datahub so your assets appear in the catalog alongside their execution history.

The plugin works with any acryl-datahub deployment—self-hosted or Cloud—and requires only configuration of the server endpoint and Dagster URL. Once registered in your Definitions, it operates transparently: every job run triggers metadata emission to acryl-datahub, building a continuous record of lineage and run outcomes without code changes to your existing Dagster jobs or assets.

Use it for

  • Track data lineage across Dagster pipelines in a centralized catalog for compliance and impact analysis.
  • Monitor job execution history and task outcomes without adding instrumentation to each Dagster job.
  • Map Dagster assets to external datasets to understand cross-system data dependencies.
  • Integrate Dagster metadata into an existing acryl-datahub deployment for unified data governance.
  • Automatically capture upstream/downstream relationships between Dagster assets for data discovery.

Worth the install?

AI-flagged interpretation of the facts on this page. Verify before relying on it.

With conditions

Yes—if you run Dagster and use acryl-datahub for data catalog and lineage, this plugin eliminates manual metadata instrumentation and keeps lineage synchronized automatically.

Low install friction, active maintenance, no known vulnerabilities, and permissive licensing make it a straightforward addition. Install only if you have both Dagster and acryl-datahub in your stack.

Install

acryl-datahub-dagster-plugin on PyPI

Before you install

Low install friction with a pure-Python wheel. Active maintenance as of 2026-08-14 with no known vulnerabilities. Requires three runtime dependencies: dagster, dagit, and acryl-datahub.

Requires Python 3.10 or later; requires a running Dagster instance and a DataHub deployment (self-hosted or Cloud).

License in practice

Licensed under Apache-2.0 (permissive), allowing use in commercial and private projects with minimal restrictions.

Quickstart

pip install acryl-datahub-dagster-plugin

from datahub.ingestion.graph.config import DatahubClientConfig
from datahub_dagster_plugin.sensors.datahub_sensors import DatahubDagsterSourceConfig, make_datahub_sensor

config = DatahubDagsterSourceConfig(
    datahub_client_config=DatahubClientConfig(server="http://localhost:8080"),
    dagster_url="http://localhost:3000",
)
datahub_sensor = make_datahub_sensor(config=config)

Verify before relying

  • Whether the sensor handles all Dagster asset types and external dataset mappings without gaps.
  • Performance impact on Dagster job execution when the sensor is active.
  • Compatibility with specific DataHub versions or deployment configurations.

Package facts

LicenseApache-2.0 permissive
Python supportSupports the current Python release >=3.10
Install frictionLow. Pure-Python wheel
Runtime dependencies
3 packages
dagitdagsteracryl-datahub
MaintenanceActively maintained 0 days since the last release
Last repo commit
First released
Downloads126,808 / month, #11,765 on PyPI 30-day window, as of 2026-08-14
Known vulnerabilitiesNone known OSV.dev, checked 2026-08-14
Classifiers
Development Status :: 5 - Production/StableEnvironment :: ConsoleEnvironment :: MacOS XIntended Audience :: DevelopersIntended Audience :: Information TechnologyIntended Audience :: System AdministratorsOperating System :: POSIX :: LinuxOperating System :: UnixProgramming Language :: PythonProgramming Language :: Python :: 3Programming Language :: Python :: 3 :: OnlyProgramming Language :: Python :: 3.10Programming Language :: Python :: 3.11Topic :: Software Development

Evidence: acryl_datahub_dagster_plugin-1.7.0.4-py3-none-any.whl

Tags

Capabilities
dagster lineage trackingdagster datahub integrationautomatic pipeline metadata captureasset lineage extractiondagster run history loggingdata catalog integrationpipeline observability
Topics
data-lineagemetadata-integrationdata-governance

Let your AI agent find packages like this

Example. Real query, live index.

You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.

wish › “dagster lineage tracking”

  • acryl-datahub-dagster-pluginAutomatically captures asset lineage, run history, and job metadata…
  • dagster-mlflowIntegrates MLflow experiment tracking and model management with…
  • dagsterDagster is a data pipeline orchestrator that lets you declare data…

Give your agent the search over MCP, or paste the wish link into any chat.

More Software Development packages

typing-extensions Worth it
PyPI · Software Development · released Jul 2026

Provides backported and experimental type hints for Python 3.9+, allowing use of newer typing features on older Python versions and enabling early experimentation with type system PEPs before they enter the standard library.

PSF-2.0pure Python · 3.9+
1.9Bdownloads / mo
numpy Worth it
PyPI · Software Development · released Aug 2026

NumPy provides an N-dimensional array object and a comprehensive suite of mathematical, linear algebra, Fourier transform, and random number functions for scientific computing in Python.

BSD-3-Clause AND 0BSD AND MIT AND Zlib AND CC0-1.0compiled wheel · 3.12+
1.1Bdownloads / mo
fastapi Worth it
PyPI · Software Development · released Jul 2026

FastAPI is a Python web framework for building REST APIs using type hints, with automatic request validation, serialization, and interactive API documentation.

MITpure Python · 3.10+
568.6Mdownloads / mo
annotated-doc With conditions
PyPI · Software Development · released Jul 2026

Provides a way to document function parameters, class attributes, return types, and variables inline using Python's `Annotated` type hint syntax instead of traditional docstrings.

MITpure Python · 3.9+
456.2Mdownloads / mo
typer Worth it
PyPI · Software Development · released Aug 2026

Typer builds command-line applications from Python functions using type hints, automatically generating help text, argument parsing, and shell completion.

Install it if you are building CLIs in Python.

MITpure Python · 3.10+
369.3Mdownloads / mo
distlib With conditions
PyPI · Software Development · released Jun 2026

Distlib provides low-level packaging utilities for building, distributing, and managing Python software—including metadata handling, version specifiers, wheel support, script installation, and dependency resolution.

permissive licensepure Python
323.3Mdownloads / mo

See also acryl-datahub-airflow-plugin · acryl-datahub · acryl-datahub-actions · dagster · dagster-dbt · datahub · acryl-datahub-classify · dagster-webserver · acryl-executor · dagster-rest-resources