{"categories":[{"label":"Distributed Computing","url":"https://skillfed.io/packages/category/system-distributed-computing/3"}],"enrichment":{"capability":"Provides a Metaflow decorator that integrates PyTorch distributed training via torchrun, allowing you to run multi-node torch programs as parallel Metaflow tasks without modifying your training code.","skillfed_tags":["pytorch-distributed","workflow-orchestration","multi-node-training"],"use_cases":["Run multi-node PyTorch DDP training as a step in a Metaflow workflow without subprocess boilerplate","Orchestrate distributed GPT or transformer training across parallel Metaflow tasks on Kubernetes or AWS Batch","Execute existing torchrun scripts inside Metaflow without rewriting training code for the workflow framework","Automate network discovery and torchrun argument configuration based on Metaflow resource decorators"],"what_it_does":"metaflow-torchrun is a plugin that bridges Metaflow workflows and PyTorch's torchrun distributed training framework. It provides a @torchrun decorator that lets you run existing PyTorch distributed programs (like DDP training) as parallel steps in a Metaflow DAG without modifying your training code. The decorator automatically handles torchrun argument selection based on Metaflow compute resource requests (CPU, GPU, memory), network discovery, and subprocess orchestration.\n\nYou use it by stacking the @torchrun decorator on a Metaflow step, then calling current.torch.run() with your training entrypoint and arguments. This pattern is useful for multi-node training jobs submitted to AWS Batch or Kubernetes, where you want Metaflow to manage task orchestration and torchrun to manage the distributed torch processes within each task.","worth_installing":"Yes, if you use Metaflow and PyTorch distributed training together. The package has no runtime dependencies, low install friction, active maintenance, and solves a real integration gap. License treatment is unclear\u2014verify Apache License compliance before production use. No known vulnerabilities."},"id":"metaflow-torchrun","links":{"html":"https://skillfed.io/packages/metaflow-torchrun","md":"https://skillfed.io/packages/metaflow-torchrun.md","pypi":"https://pypi.org/project/metaflow-torchrun/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-07-15","license_spdx":null,"license_treatment":"unclear","name":"metaflow-torchrun","python_support":"unspecified","summary":"A torchrun decorator for Metaflow"},"popularity":{"monthly_downloads":82474,"position":14161,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"0.2.2"}