{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/3"}],"enrichment":{"capability":"TorchRL is a PyTorch-native toolkit for building reinforcement learning systems with composable components for environments, policies, collectors, replay buffers, and loss functions.","skillfed_tags":["reinforcement-learning","pytorch-native","multi-agent"],"use_cases":["Prototyping single-agent RL algorithms locally, then scaling to distributed training without changing the data model or core training code.","Building multi-agent RL systems with explicit agent grouping, value normalization, and algorithms like MAPPO and IPPO.","Training recurrent policies with optimized GRU/LSTM reset handling and scan-based forward passes.","Integrating custom MuJoCo environments or wrappers for third-party simulators (Gymnasium, Isaac Lab, Brax) with standardized observation and action specs.","Managing large replay buffers with prioritized sampling, async writes, and optional CUDA-accelerated kernels.","Implementing offline RL or model-based workflows where the same TensorDict interface handles both real and synthetic trajectories."],"what_it_does":"TorchRL is a modular reinforcement learning library built on PyTorch and TensorDict, designed to keep research code close to the PyTorch programming model while scaling from local prototypes to distributed, multi-agent, and model-based workflows. It provides reusable components\u2014environments, policies, collectors, replay buffers, transforms, and loss functions\u2014that communicate through a common TensorDict data model, eliminating the need to rewrite training loops when switching between single-process, vectorized, multiprocess, or distributed execution.\n\nThe library emphasizes composability and explicit structure: data carries names, batch dimensions, and device information throughout the training loop, and each component (environment, policy, replay buffer, loss) can be swapped independently. It includes native PyTorch environments, wrappers for popular libraries (Gymnasium, DM Control, Brax, PettingZoo, VMAS, OpenSpiel, Isaac Lab), vectorized containers for local and multiprocess execution, and a rich set of transforms for observation normalization, action scaling, reward shaping, and state reconstruction.","worth_installing":"Yes, with conditions. TorchRL is actively maintained, has no known vulnerabilities, and is well-suited for research and production RL systems that need to scale from prototypes to distributed training. However, verify the license status before committing to proprietary use, and ensure your target platform has compatible wheels (Python 3.10\u20133.14, macOS/Linux/Windows). Medium install friction due to torch and tensordict dependencies is typical for PyTorch-based ML libraries."},"id":"torchrl","links":{"html":"https://skillfed.io/packages/torchrl","md":"https://skillfed.io/packages/torchrl.md","pypi":"https://pypi.org/project/torchrl/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-07-14","license_spdx":null,"license_treatment":"unclear","name":"torchrl","python_support":"supports_current","summary":"A modular, primitive-first, python-first PyTorch library for Reinforcement Learning"},"popularity":{"monthly_downloads":1313205,"position":4070,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"0.13.3"}