ml-pipeline-workflow
ML Pipeline Workflow guides you through constructing production-ready MLOps systems that span data ingestion, preparation, model training, validation, and deployment. It covers pipeline architecture, DAG orchestration patterns, data quality checks, experiment tracking integration, and deployment strategies including canary and blue-green approaches.
ML Pipeline Workflow helps you build complete MLOps pipelines from data preparation through production deployment.
AI-generated summary based on this skill's SKILL.md
Decision gist · record as of 2026-07-22
ML Pipeline Workflow helps you build complete MLOps pipelines from data preparation through production deployment. ML Pipeline Workflow guides you through constructing production-ready MLOps systems that span data ingestion, preparation, model training, validation, and deployment. It covers pipeline architecture, DAG orchestration patterns, data quality checks, experiment tracking integration, and deployment strategies including canary and blue-green approaches.
Use it when
- ML Pipeline Workflow implements MLOps best practices for production machine learning systems, including reproducible workflow design.
- ML Pipeline Workflow provides patterns for automating the complete ML workflow lifecycle.
Verify before relying
Read SKILL.md below before installing (1 file). Open directory: indexed for reading, not audited.
Install
wshobson/agents/ml-pipeline-workflow · repository language: Python
Open directory. Skills are indexed for reading, not audited. Review a skill's body before installing it.
Frequently asked questions
AI-generated answers based on this skill's SKILL.md and metadata
How do I build an end-to-end ML pipeline from data to deployment?
ML Pipeline Workflow teaches you to construct complete production systems spanning data ingestion, preparation, model training, validation, and deployment. The guide covers DAG orchestration patterns, data quality checks, experiment tracking integration, and deployment strategies including canary and blue-green approaches to ensure your pipeline moves data through each stage reliably.
What MLOps best practices does ML Pipeline Workflow emphasize?
ML Pipeline Workflow implements MLOps best practices for production machine learning systems, including reproducible workflow design, scalable pipeline architecture, automated model training and validation, and integrated monitoring with error handling. These practices ensure your ML systems remain maintainable, traceable, and resilient in production environments.
How can I automate machine learning workflow from data ingestion through deployment?
ML Pipeline Workflow provides patterns for automating the complete ML workflow lifecycle. It covers orchestrating data ingestion, preparation, training, and deployment stages through DAG-based systems, enabling continuous training pipelines with versioning and lineage tracking. Automation reduces manual steps and ensures consistent, repeatable model delivery.
What pipeline architecture patterns does ML Pipeline Workflow teach?
ML Pipeline Workflow guides you through designing reproducible and scalable ML pipeline architecture using DAG orchestration concepts. It covers component integration strategies, data quality validation gates, experiment tracking connections, and deployment topology patterns. These architectural foundations support both small prototypes and large-scale production systems.
How does ML Pipeline Workflow handle monitoring and error recovery?
ML Pipeline Workflow integrates monitoring and error handling throughout your ML workflows, including retry strategies, validation checkpoints, and failure recovery patterns. These capabilities ensure your pipeline gracefully handles data issues, training failures, and deployment problems while maintaining visibility into system health.
Is ML Pipeline Workflow open source and what license does it use?
ML Pipeline Workflow is released under the MIT license, making it freely available for commercial and personal use. The open-source nature allows you to inspect, modify, and integrate the pipeline patterns into your own MLOps infrastructure.
SKILL.md
Rendered from the published skill. Quoted content, verbatim.
ML Pipeline Workflow
Complete end-to-end MLOps pipeline orchestration from data preparation through model deployment.
Overview
This skill provides comprehensive guidance for building production ML pipelines that handle the full lifecycle: data ingestion → preparation → training → validation → deployment → monitoring.
When to Use This Skill
- Building new ML pipelines from scratch
- Designing workflow orchestration for ML systems
- Implementing data → model → deployment automation
- Setting up reproducible training workflows
- Creating DAG-based ML orchestration
- Integrating ML components into production systems
What This Skill Provides
Core Capabilities
- Pipeline Architecture
- End-to-end workflow design
- DAG orchestration patterns (Airflow, Dagster, Kubeflow)
- Component dependencies and data flow
-
Error handling and retry strategies
-
**Data
(truncated - see the full file via the links below)
File tree — 1 file
plugins/machine-learning-ops/skills/ml-pipeline-workflow/SKILL.md
Let your AI agent find skills like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 56,283 agent skills by what they can do, searchable in plain language.
wish › “Build and orchestrate end-to-end ML pipelines from data prep through deployment”
Give your agent the search over MCP, or paste the wish link into any chat. No install? Search from any chat →
Related skills
ML MLOps guides you through building auditable, repeatable machine learning workflows. It covers experiment tracking, model versioning and governance, pipeline orchestration across Kubernetes, AWS, GCP, and Azure, CI/CD automation, and production monitoring to catch drift and quality issues.
Master the principles for constructing reliable machine learning systems from data collection through deployment. Learn pipeline design patterns, feature engineering strategies, model validation checklists, and serving approaches—plus monitoring techniques to detect drift and trigger retraining.
Implementing MLOps equips teams to operationalize machine learning models across the full lifecycle—from experiment tracking and model versioning through feature engineering, deployment, and observability. It covers platform selection for experiment management, feature store implementation, model serving strategies, and pipeline orchestration to help you transition from notebooks to robust, governed production systems.
This skill guides you through deploying machine learning workloads on managed cloud platforms, Kubernetes clusters, and serverless systems. It covers platform selection across AWS, GCP, Azure, Databricks, and specialized providers, plus practical patterns for endpoint configuration, training job orchestration, and scaling decisions based on your workload's latency, throughput, and compliance needs.
MLOps Workflows guides you through production-grade machine learning operations using MLflow, covering experiment tracking, model registry management, deployment patterns, and monitoring. Learn to version models, run A/B tests, and implement CI/CD practices for reliable ML systems.
ML Pipeline Automation handles the complete machine learning lifecycle, automating data collection, preprocessing, model training, validation, and production deployment. Built on orchestration platforms like Airflow and Kubeflow, it ensures reproducible and scalable workflows with integrated monitoring and performance tracking.
More skills ai-ml-data-science (MIT) · ml-pipeline-automation (MIT) · airflow-dag-patterns (MIT) · Ml Engineering (unlicensed) · ai-architect-expert (Apache-2.0) · ml-expert (Apache-2.0)