dagster-duckdb

What it is and what it does

dagster-duckdb is a library that bridges Dagster's data orchestration framework with DuckDB, a lightweight analytical database engine. It provides Dagster-native components—ops and resources—specifically designed to work with DuckDB, allowing you to declare data assets that read from, transform, or write to DuckDB tables as part of a larger Dagster pipeline.

The package is part of Dagster's broader integration ecosystem and is maintained by the same team. It lets you treat DuckDB operations as first-class Dagster assets, with automatic dependency tracking, lineage, and observability. You use it by importing DuckDB resources into your asset definitions and calling them within your Python functions, just as you would any other Dagster resource.

Use it for:

• Build and orchestrate data pipelines that use DuckDB as the analytical backend, with Dagster managing scheduling and asset dependencies.
• Define Dagster assets that query or transform data stored in DuckDB tables, with automatic lineage tracking.
• Integrate DuckDB into a multi-tool data stack where Dagster serves as the central orchestration layer.
• Test DuckDB-based data transformations locally before deploying to production, leveraging Dagster's built-in testing framework.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Integrates DuckDB with Dagster's data pipeline orchestration, providing DuckDB-specific ops and resources for declaring and running data assets.

Yes. This is a lightweight, actively maintained integration package with no known vulnerabilities, permissive licensing, and low install friction. Install it if you are already using Dagster and want to work with DuckDB; it adds minimal overhead and is backed by a well-resourced open-source project.

Install

dagster-duckdb on PyPI

pip install dagster-duckdb

uv add dagster-duckdb

poetry add dagster-duckdb

Installing dagster-duckdb

Before you install

Low install friction with a single wheel dependency. Actively maintained with a release on 2026-08-14 and 15996 GitHub stars.

License in practice

Apache 2.0 permissive license allows commercial and private use with minimal restrictions.

Quickstart

pip install dagster-duckdb

import dagster as dg
from dagster_duckdb import DuckDBResource

@dg.asset
def my_table(duckdb: DuckDBResource) -> None:
    duckdb.execute("CREATE TABLE data AS SELECT id")

Requires Python 3.10 or later (supports up to 3.14); dagster must be installed alongside this package.

Verify before relying

• Whether this package includes pre-built DuckDB I/O managers or only lower-level ops and resources
• Specific version compatibility between dagster-duckdb 0.29.18 and the main dagster package
• Whether DuckDB must be installed separately or is bundled as a dependency

Package facts

Evidence: dagster_duckdb-0.29.18-py3-none-any.whl

Tags

More Distributed Computing packages