piper
A lightweight python toolkit for gluing together restartable, robust command line pipelines
Decision gist · record as of 2026-08-14
Yes, if you're building multi-step shell-based workflows in Python and need restartability, resource monitoring, and structured logging. The active maintenance, permissive license, low install friction, and modern Python support make it a solid choice. No known security vulnerabilities. Not necessary for simple one-off scripts or if you prefer pure Python tooling over shell integration.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires Python 3.10 or later.
- Low install friction with a pure-Python wheel.
- Active maintenance with a recent commit on 2026-03-06 and ongoing support for current Python versions (3.10 through 3.14).
License · maintenance · safety
BSD-2-Clause (permissive) — BSD-2-Clause is permissive, allowing commercial and private use with minimal restrictions beyond attribution and liability disclaimers.
last release 2026-03-06 (161 days) · last repo commit 2026-03-06 · 48 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 104,724 downloads/mo, #12,739 on PyPI
Alternatives
Verify before relying
pip install piper
import piper
# Create and run a pipeline with shell command execution- Specific API and class names for creating and managing pipelines.
- Whether automatic restartability works across all shell environments or has platform-specific limitations.
- How file integrity protection is implemented and what formats it supports.
- Whether resource monitoring integrates with container orchestration systems.
What it is and what it does
Piper is a Python library that wraps shell command execution to add workflow management features on top of standard subprocess calls. It's designed for multi-step pipelines that chain together command-line tools, where robustness and reproducibility matter. The package handles restarting failed pipelines from checkpoints, validates output files, tracks resource usage via psutil, and logs execution details through logmuse. It integrates with pipestat for status reporting and yacman for configuration management.
The library targets developers building multi-step workflows that call external tools—common in bioinformatics, data science, and systems administration. Rather than writing shell scripts or reinventing error handling, you define pipeline steps in Python and let piper manage execution state, resource constraints, and detailed audit trails. It has been actively maintained since 2013 and currently supports modern Python versions.
Use it for
- Build bioinformatics pipelines that chain alignment, variant calling, and annotation tools with automatic restartability.
- Monitor resource usage and enforce limits on long-running data processing workflows.
- Log and audit multi-step ETL pipelines with detailed execution records and file integrity checks.
- Orchestrate shell-based data analysis workflows in containerized environments.
- Implement checkpoint-based restarts for pipelines that fail partway through expensive computations.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you're building multi-step shell-based workflows in Python and need restartability, resource monitoring, and structured logging.
The active maintenance, permissive license, low install friction, and modern Python support make it a solid choice. No known security vulnerabilities. Not necessary for simple one-off scripts or if you prefer pure Python tooling over shell integration.
Install
piper on PyPI
Before you install
Low install friction with a pure-Python wheel. Active maintenance with a recent commit on 2026-03-06 and ongoing support for current Python versions (3.10 through 3.14).
Requires Python 3.10 or later.
License in practice
BSD-2-Clause is permissive, allowing commercial and private use with minimal restrictions beyond attribution and liability disclaimers.
Quickstart
pip install piper
import piper
# Create and run a pipeline with shell command executionVerify before relying
- Specific API and class names for creating and managing pipelines.
- Whether automatic restartability works across all shell environments or has platform-specific limitations.
- How file integrity protection is implemented and what formats it supports.
- Whether resource monitoring integrates with container orchestration systems.
Package facts
| License | BSD-2-Clause permissive |
| Python support | Supports the current Python release >=3.10 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 5 packageslogmusepipestatpsutilubiquergyacman |
| Maintenance | Actively maintained 161 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 104,724 / month, #12,739 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Development Status :: 4 - BetaLicense :: OSI Approved :: BSD LicenseProgramming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Programming Language :: Python :: 3.13Programming Language :: Python :: 3.14Topic :: Scientific/Engineering :: Bio-InformaticsTopic :: Software Development :: Libraries :: Python ModulesTopic :: System :: Systems Administration |
Evidence: piper-0.15.1-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “restartable shell pipeline”
- piperPypiper manages shell command execution within Python workflows,…
- dagster-shellProvides shell operation support for Dagster data pipelines, enabling…
- prefect-shellProvides Prefect workflow tasks for executing shell commands and…
Give your agent the search over MCP, or paste the wish link into any chat.
More Python Modules packages
Converts domain names between Unicode and ASCII-compatible encoding (Punycode) according to IDNA 2008 and Unicode Technical Standard 46, with security validation and broader script coverage than the standard library.
Install it if you work with internationalized domain names, need to validate domains, or use HTTP clients that depend on it transitively.
Setuptools is a Python build backend and package management tool that handles building, distributing, and installing Python packages, including support for C/C++ extension modules.
PyYAML parses and emits YAML 1.1 data format, enabling serialization and deserialization of configuration files and Python objects to and from human-readable YAML text.
Pydantic validates Python data structures against type hints, coercing and checking input at runtime to ensure it matches a declared schema.
Provides reusable metadata objects for use with PEP-593 `typing.Annotated` to express common constraints like bounds, collection sizes, and predicates on types.
Install it if you use or build libraries that need to express type constraints in a standardized, inspectable way—or if you want to annotate your own types with…
Provides runtime tools to inspect and introspect Python type annotations, enabling programmatic examination of type hints at execution time.
See also dagster-pipes · launchable · robust-downloader · peppy · kfp · pypyp · kfp-pipeline-spec · robocorp-workitems · prefect-shell · pipestat