{"categories":[{"label":"Distributed Computing","url":"https://skillfed.io/packages/category/system-distributed-computing/3"}],"enrichment":{"capability":"Integrates Hydra configuration framework with Submitit to submit Python functions as Slurm cluster jobs directly from configuration-driven applications.","skillfed_tags":["slurm-integration","hydra-plugin","cluster-computing"],"use_cases":["Run Hydra-configured machine learning experiments across multiple Slurm jobs with different hyperparameters.","Submit batch data processing tasks from a Hydra application to a cluster without modifying core application code.","Integrate parameter sweeps defined in Hydra config files directly to Slurm for large-scale research workflows.","Switch between local testing and cluster execution by changing Hydra launcher configuration without code changes."],"what_it_does":"Hydra-submitit-launcher is a plugin that bridges Hydra (a configuration management framework) with Submitit (a Slurm job submission tool). It allows you to define your application configuration in Hydra and then submit jobs to a Slurm cluster without writing cluster-specific code directly in your Python functions. The launcher handles job submission, monitoring, and result retrieval through Hydra's standard launcher interface.\n\nThe package is designed for researchers and engineers running parameter sweeps, hyperparameter searches, or batch computations on shared clusters. Instead of manually crafting Slurm submission scripts or calling Submitit directly, you configure your job parameters in Hydra's YAML files and let the launcher handle cluster interaction. It abstracts away Slurm details while preserving direct control over individual job logs and preemption handling.","worth_installing":"Yes, if you are already using Hydra for configuration management and have access to a Slurm cluster. The integration is straightforward and the permissive license carries no restrictions. However, note that the package has not been updated since May 2022; verify compatibility with your versions of hydra-core and submitit before committing to production use, and monitor the repository for security or compatibility issues."},"id":"hydra-submitit-launcher","links":{"html":"https://skillfed.io/packages/hydra-submitit-launcher","md":"https://skillfed.io/packages/hydra-submitit-launcher.md","pypi":"https://pypi.org/project/hydra-submitit-launcher/"},"maintenance":{"status":"aging"},"meta":{"latest_release":"2022-05-17","license_spdx":null,"license_treatment":"permissive","name":"hydra-submitit-launcher","python_support":"unspecified","summary":"Submitit Launcher for Hydra apps"},"popularity":{"monthly_downloads":93072,"position":13402,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"1.2.0"}