{"categories":[{"label":"Distributed Computing","url":"https://skillfed.io/packages/category/system-distributed-computing"}],"enrichment":{"capability":"Metaflow is a framework for building, prototyping, and deploying AI and ML systems, handling the full lifecycle from local development through production orchestration with support for scaling across cloud compute resources.","skillfed_tags":["ml-orchestration","workflow-management","cloud-native"],"use_cases":["Prototype ML models locally in notebooks, then scale the same code to run on distributed cloud compute without modification","Track experiments, versions, and artifacts across team members with built-in versioning and visualization","Deploy data pipelines and ML workflows to production orchestrators with one-click deployment and event-driven triggering","Run embarrassingly parallel or gang-scheduled compute jobs reliably across CPUs and GPUs with automatic failure recovery","Manage dependencies and data access for large-scale data processing jobs handling petabytes of data"],"what_it_does":"Metaflow is a framework for managing the full lifecycle of AI and ML projects, from rapid local prototyping to production deployment. It provides a Pythonic API that unifies code, data, and compute management, allowing teams to write workflows once and scale them across local machines, cloud infrastructure, or production orchestrators without rewriting. The framework handles experiment tracking, versioning, dependency management, and both horizontal and vertical scaling with support for CPUs and GPUs.\n\nOriginally developed at Netflix and now supported by Outerbounds, Metaflow is designed for teams of any size working on classical statistics, deep learning, or foundation models. It reduces the engineering burden of moving from notebook prototypes to reliable production systems by providing built-in support for distributed computing, failure recovery, checkpointing, and reactive orchestration. The package depends on requests and boto3, making it suitable for cloud-native workflows, particularly on AWS.","worth_installing":"Yes. Metaflow is actively maintained, has low install friction, carries a permissive license, and is backed by proven production use at scale (Netflix runs 3000+ projects on it). It solves a real problem\u2014bridging the gap between notebook prototyping and production ML systems\u2014with a mature, well-documented API. Install if you're building ML workflows that need to scale beyond a single machine or move from experimentation to production."},"id":"metaflow","links":{"html":"https://skillfed.io/packages/metaflow","md":"https://skillfed.io/packages/metaflow.md","pypi":"https://pypi.org/project/metaflow/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-11","license_spdx":null,"license_treatment":"permissive","name":"metaflow","python_support":"unspecified","summary":"Metaflow: More AI and ML, Less Engineering"},"popularity":{"monthly_downloads":930396,"position":4702,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"2.19.37"}