ml-pipeline-workflow
ML Pipeline Workflow guides you through constructing production-ready MLOps systems that span data ingestion, preparation, model training, validation, and deployment. It covers pipeline architecture, DAG orchestration patterns, data quality checks, experiment tracking integration, and deployment strategies including canary and blue-green approaches.
ML Pipeline Workflow helps you build complete MLOps pipelines from data preparation through production deployment.
AI-generated summary based on this skill's SKILL.md
Install
wshobson/agents/ml-pipeline-workflow · repository language: Python
git clone https://github.com/wshobson/agents
cp -r agents/plugins/machine-learning-ops/skills/ml-pipeline-workflow ~/.claude/skills/ml-pipeline-workflownpx skillfed install wshobson/agents/ml-pipeline-workflowFrequently asked questions
AI-generated answers based on this skill's SKILL.md and metadata
How do I build an end-to-end ML pipeline from data to deployment?
ML Pipeline Workflow teaches you to construct complete production systems spanning data ingestion, preparation, model training, validation, and deployment. The guide covers DAG orchestration patterns, data quality checks, experiment tracking integration, and deployment strategies including canary and blue-green approaches to ensure your pipeline moves data through each stage reliably.
What MLOps best practices does ML Pipeline Workflow emphasize?
ML Pipeline Workflow implements MLOps best practices for production machine learning systems, including reproducible workflow design, scalable pipeline architecture, automated model training and validation, and integrated monitoring with error handling. These practices ensure your ML systems remain maintainable, traceable, and resilient in production environments.
How can I automate machine learning workflow from data ingestion through deployment?
ML Pipeline Workflow provides patterns for automating the complete ML workflow lifecycle. It covers orchestrating data ingestion, preparation, training, and deployment stages through DAG-based systems, enabling continuous training pipelines with versioning and lineage tracking. Automation reduces manual steps and ensures consistent, repeatable model delivery.
What pipeline architecture patterns does ML Pipeline Workflow teach?
ML Pipeline Workflow guides you through designing reproducible and scalable ML pipeline architecture using DAG orchestration concepts. It covers component integration strategies, data quality validation gates, experiment tracking connections, and deployment topology patterns. These architectural foundations support both small prototypes and large-scale production systems.
How does ML Pipeline Workflow handle monitoring and error recovery?
ML Pipeline Workflow integrates monitoring and error handling throughout your ML workflows, including retry strategies, validation checkpoints, and failure recovery patterns. These capabilities ensure your pipeline gracefully handles data issues, training failures, and deployment problems while maintaining visibility into system health.
Is ML Pipeline Workflow open source and what license does it use?
ML Pipeline Workflow is released under the MIT license, making it freely available for commercial and personal use. The open-source nature allows you to inspect, modify, and integrate the pipeline patterns into your own MLOps infrastructure.
SKILL.md
rendered from the published skill — quoted content, verbatim
ML Pipeline Workflow
Complete end-to-end MLOps pipeline orchestration from data preparation through model deployment.
Overview
This skill provides comprehensive guidance for building production ML pipelines that handle the full lifecycle: data ingestion → preparation → training → validation → deployment → monitoring.
When to Use This Skill
- Building new ML pipelines from scratch
- Designing workflow orchestration for ML systems
- Implementing data → model → deployment automation
- Setting up reproducible training workflows
- Creating DAG-based ML orchestration
- Integrating ML components into production systems
What This Skill Provides
Core Capabilities
- Pipeline Architecture
- End-to-end workflow design
- DAG orchestration patterns (Airflow, Dagster, Kubeflow)
- Component dependencies and data flow
-
Error handling and retry strategies
-
**Data
(truncated - see the full file via the links below)
Read as markdown · JSON record · Browse the source repository
File tree — 1 file
plugins/machine-learning-ops/skills/ml-pipeline-workflow/SKILL.md