{"categories":[{"label":"Distributed Computing","url":"https://skillfed.io/packages/category/system-distributed-computing/2"}],"enrichment":{"capability":"Provides shell operation support for Dagster data pipelines, enabling you to execute shell commands and scripts as part of your orchestrated data workflows.","skillfed_tags":["orchestration","shell-integration","data-pipeline"],"use_cases":["Invoke existing shell scripts or command-line tools as part of a larger Dagster pipeline without rewriting them in Python.","Execute system administration tasks like file transfers, backups, or environment setup as orchestrated pipeline steps.","Integrate third-party CLI tools (e.g., dbt, terraform, custom binaries) into a Dagster-managed data workflow.","Run data processing commands that are simpler or more efficient to express in shell than in Python code."],"what_it_does":"dagster-shell is a library that extends Dagster with the ability to define and orchestrate shell operations within your data pipelines. It wraps shell command execution as first-class Dagster ops, allowing you to integrate system-level scripts, command-line tools, and shell workflows into your declarative asset and job definitions. This is useful when you have existing shell scripts, need to invoke system utilities, or want to orchestrate heterogeneous tools that expose command-line interfaces.\n\nThe package is part of the Dagster ecosystem and inherits its design philosophy: your shell operations are defined as Python functions decorated with Dagster markers, then scheduled, monitored, and lineage-tracked through Dagster's unified control plane. It supports Python 3.9 through 3.12 and is actively maintained by the Dagster team.","worth_installing":"Yes, if you have existing shell scripts or command-line tools that need to be part of a Dagster pipeline. The package is lightweight, actively maintained, has no known vulnerabilities, and integrates seamlessly with Dagster's orchestration model. Install it only if you actually need shell operation support; if your pipeline is purely Python-based, it adds no value."},"id":"dagster-shell","links":{"html":"https://skillfed.io/packages/dagster-shell","md":"https://skillfed.io/packages/dagster-shell.md","pypi":"https://pypi.org/project/dagster-shell/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2025-02-11","license_spdx":null,"license_treatment":"permissive","name":"dagster-shell","python_support":"capped_below_current","summary":"Package for Dagster shell ops."},"popularity":{"monthly_downloads":306237,"position":7788,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"0.25.13"}