dagster-rest-resources

What it is and what it does

dagster-rest-resources is a Dagster integration library that brings REST API connectivity into Dagster's asset orchestration model. It sits between Dagster's declarative asset framework and HTTP endpoints, allowing you to fetch, transform, and orchestrate data from REST services as first-class Dagster assets. The package wraps httpx for HTTP communication and integrates with pydantic for data validation, letting you define assets that pull from REST APIs and participate in Dagster's dependency graph, lineage tracking, and observability.

You use it by decorating asset functions with Dagster's @asset decorator and injecting a REST resource that handles the HTTP calls. This lets you treat external API data the same way you treat database tables or local files—as managed, versioned, observable data assets that Dagster orchestrates alongside your other pipelines. It's designed for teams building data platforms that need to ingest, combine, and monitor data from multiple REST sources.

Use it for:

• Fetch data from third-party REST APIs and materialize it as Dagster assets for downstream processing.
• Build multi-stage pipelines where one asset calls a REST endpoint and passes results to dependent assets.
• Monitor and observe REST API data ingestion with Dagster's built-in lineage and observability tools.
• Integrate REST-based microservices into a unified data orchestration platform.
• Test REST integrations locally and promote them through staging to production with Dagster's environment support.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Provides REST API resource integrations for Dagster data pipelines, enabling HTTP-based asset definitions and orchestration within Dagster's declarative asset framework.

Yes, if you are already using Dagster and need to ingest or orchestrate data from REST APIs. The package has low install friction, active maintenance, no known vulnerabilities, and Apache-2.0 licensing. It is a natural fit for Dagster users building data platforms that consume external HTTP services. Not relevant if you are not using Dagster or do not need REST API integration.

Install

dagster-rest-resources on PyPI

pip install dagster-rest-resources

uv add dagster-rest-resources

poetry add dagster-rest-resources

Installing dagster-rest-resources

Before you install

Low friction install with three lightweight runtime dependencies (dagster-shared, httpx, pydantic). Active maintenance as of 2026-08-14 with no reported vulnerabilities.

License in practice

Apache-2.0 licensed under permissive terms, allowing use in commercial and proprietary projects with minimal restriction.

Quickstart

pip install dagster-rest-resources

import dagster as dg
from dagster_rest_resources import rest_api_resource

@dg.asset
def my_rest_asset(rest_api: rest_api_resource) -> dict:
    return rest_api.get("https://api.example.com/data")

Requires Python 3.10 or later (supports 3.10–3.14); httpx must be available at runtime.

Verify before relying

• Specific REST authentication methods supported (basic, OAuth, API keys, etc.)
• Whether this package provides pre-built connectors for common REST APIs or is a generic HTTP client wrapper
• Performance characteristics and rate-limiting or retry behavior
• Whether REST responses are automatically mapped to Dagster asset types or require manual serialization

Package facts

Evidence: dagster_rest_resources-0.29.18-py3-none-any.whl

Tags

More Distributed Computing packages