{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/6"}],"enrichment":{"capability":"Prodigy is a PyTorch optimizer that adapts the learning rate automatically during training, eliminating the need to manually tune this critical hyperparameter.","skillfed_tags":["optimizer","pytorch","hyperparameter-free"],"use_cases":["Training standard neural networks (e.g., ResNets) when you want to avoid manual learning rate tuning.","Fine-tuning models where adaptive learning rate estimation can reduce hyperparameter search overhead.","Training diffusion models with the recommended settings for `safeguard_warmup`, `use_bias_correction`, and `weight_decay`.","Memory-constrained training scenarios where `slice_p` can be set to values like 11 to reduce memory consumption."],"what_it_does":"Prodigy is an optimizer for training neural networks in PyTorch that automatically estimates a suitable learning rate during training, removing the need to manually set this hyperparameter. It is based on research published in the paper 'Prodigy: An Expeditiously Adaptive Parameter-Free Learner' and implements an Adam-like algorithm with adaptive learning rate estimation. The optimizer supports weight decay (decoupled or standard L2 regularization), memory-efficient slicing via the `slice_p` parameter, and optional bias correction and warmup safeguards.\n\nTypical usage involves instantiating the optimizer with a network's parameters and a default learning rate of 1.0, then optionally pairing it with a learning rate scheduler like cosine annealing. The package is designed to work out of the box for most training tasks, though the documentation provides tuning guidance for specialized use cases such as diffusion models, where specific settings like `safeguard_warmup=True` and `weight_decay=0.01` are recommended.","worth_installing":"Yes, if you use PyTorch and want to reduce learning rate tuning effort. The optimizer has no external dependencies, is permissively licensed, and receives regular maintenance. However, verify that PyTorch is available in your environment, as it is not declared as a package dependency. The dormant maintenance status means bug fixes or feature additions are unlikely, but the core algorithm is stable and well-documented."},"id":"prodigyopt","links":{"html":"https://skillfed.io/packages/prodigyopt","md":"https://skillfed.io/packages/prodigyopt.md","pypi":"https://pypi.org/project/prodigyopt/"},"maintenance":{"status":"dormant"},"meta":{"latest_release":"2025-01-16","license_spdx":null,"license_treatment":"permissive","name":"prodigyopt","python_support":"supports_current","summary":"An Adam-like optimizer for neural networks with adaptive estimation of learning rate"},"popularity":{"monthly_downloads":275906,"position":8170,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"1.1.2"}