dagster-ssh

What it is and what it does

dagster-ssh is a Dagster integration library that adds SSH capabilities to data pipelines. It wraps paramiko and sshtunnel to provide Dagster-native resources for executing tasks and transferring data over SSH connections to remote servers. This allows you to orchestrate data workflows that interact with remote systems without leaving the Dagster framework.

The package is part of the official Dagster ecosystem and is actively maintained alongside the core Dagster project. It integrates with Dagster's asset and op model, letting you declare remote operations as part of your data pipeline graph. With low installation friction and no known vulnerabilities, it's suitable for production use in environments where remote SSH access is a requirement.

Use it for:

• Execute data processing scripts on remote servers and collect results back into Dagster assets
• Transfer data files to or from remote systems as part of a larger orchestrated pipeline
• Establish SSH tunnels to access databases or services behind firewalls within Dagster workflows
• Coordinate multi-machine data pipelines where some assets live on remote infrastructure

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Provides SSH resource and I/O manager components for Dagster data pipelines, enabling remote execution and data transfer over SSH connections.

Yes, if you need SSH-based remote execution or data transfer in Dagster pipelines. The package is actively maintained, has no known vulnerabilities, and integrates cleanly with Dagster's asset model. Install it when your data workflow requires interaction with remote systems over SSH; skip it if all your assets run locally or via other Dagster integrations.

Install

dagster-ssh on PyPI

pip install dagster-ssh

uv add dagster-ssh

poetry add dagster-ssh

Installing dagster-ssh

Before you install

Low installation friction with three straightforward runtime dependencies. Actively maintained as part of the Dagster ecosystem with a recent release and no known vulnerabilities.

License in practice

Apache 2.0 permissive license allows free use, modification, and distribution with minimal restrictions, suitable for both open-source and commercial projects.

Quickstart

pip install dagster-ssh

from dagster_ssh import SSHResource
import dagster as dg

@dg.asset
def my_asset(ssh: SSHResource) -> str:
    # Use ssh resource to execute commands or transfer data
    return "data"

Requires Python 3.10 or later; SSH server credentials and network access must be configured before use.

Verify before relying

• Whether the package supports SSH key-based authentication, password authentication, or both
• Specific SSH operations supported (command execution, file transfer, tunneling details)
• Whether it integrates with Dagster's asset materialization or also supports ops/jobs
• Performance characteristics for large data transfers or long-running remote commands

Package facts

Evidence: dagster_ssh-0.29.18-py3-none-any.whl

Tags

More Distributed Computing packages