{"enrichment":{"faq":[{"a":"PyTorch Lightning handles distributed training through its Trainer class. Set the `strategy` parameter to 'ddp' (Distributed Data Parallel), 'fsdp' (Fully Sharded Data Parallel), or 'deepspeed' and specify `devices='auto'` or a device count. Lightning automatically manages process spawning, gradient synchronization, and communication across GPUs or nodes\u2014no code changes needed to your LightningModule.","q":"How to use pytorch lightning for distributed training?"},{"a":"PyTorch Lightning eliminates boilerplate by automating device management, mixed precision, checkpointing, and logging. Instead of writing 40+ lines of training loop code with manual GPU handling and callback orchestration, you define a LightningModule, configure a Trainer with your desired settings (GPU count, precision, strategy), and call `trainer.fit()`. Lightning handles the rest.","q":"What does PyTorch Lightning do compared to raw PyTorch?"},{"a":"Yes, PyTorch Lightning supports GPU, CPU, and TPU through unified device abstraction. Set `accelerator='gpu'`, `accelerator='cpu'`, or `accelerator='tpu'` in the Trainer, and optionally specify `devices='auto'` to use all available hardware. Your LightningModule code remains unchanged regardless of target hardware.","q":"Does PyTorch Lightning support GPU, CPU, and TPU?"},{"a":"PyTorch Lightning provides built-in callbacks like `EarlyStopping` that monitor validation metrics and halt training when no improvement occurs for a specified patience window. Pass callbacks to the Trainer: `trainer = Trainer(callbacks=[EarlyStopping(monitor='val_loss', patience=3)])`. Custom callbacks can also log metrics, save checkpoints, or adjust learning rates automatically.","q":"How do PyTorch Lightning callbacks enable early stopping?"},{"a":"PyTorch Lightning supports mixed precision training (fp16, bf16) via the `precision` parameter in Trainer, reducing memory footprint and accelerating computation. For very large models, use `strategy='fsdp'` (Fully Sharded Data Parallel) to shard parameters across devices, or integrate DeepSpeed for advanced memory optimization and gradient checkpointing.","q":"Can PyTorch Lightning optimize memory and precision for large models?"},{"a":"A LightningModule is a PyTorch nn.Module subclass that organizes your model, optimizer, and training logic into standardized methods: `forward()`, `training_step()`, `validation_step()`, and `configure_optimizers()`. Pass it to a Trainer with your DataLoader, call `trainer.fit()`, and Lightning orchestrates the training loop, validation, checkpointing, and logging automatically.","q":"What is a LightningModule and how do I structure training?"}],"shadow_tags":["neural-network-training","gpu-acceleration","model-scaling","experiment-tracking","training-automation","ml-engineering","reproducibility-framework","hardware-abstraction","batch-processing","deep-learning-ops"],"summary_rewrite":"PyTorch Lightning transforms raw PyTorch code into clean, organized training workflows by handling device management, distributed strategies (DDP, FSDP, DeepSpeed), and logging automatically. Define your model as a LightningModule, pass it to Trainer with your data, and let the framework manage GPU/TPU switching, mixed precision, checkpointing, and callbacks\u2014reducing typical training code from 40+ lines to 15."},"files":[{"bytes":8971,"path":"optional-skills/mlops/pytorch-lightning/SKILL.md","sha256":"7f35d8b7bed8dde58a13616c26b7128de305e5ab532bce45ad74c150bd875b54","url":"https://skillfed.io/files/NousResearch/hermes-agent/pytorch-lightning/a46410e9/SKILL.md"}],"id":"NousResearch/hermes-agent/pytorch-lightning","links":{"html":"https://skillfed.io/NousResearch/hermes-agent/pytorch-lightning","md":"https://skillfed.io/NousResearch/hermes-agent/pytorch-lightning.md","repo":"https://github.com/NousResearch/hermes-agent"},"meta":{"agents_supported":[],"first_seen":"2026-07-28","forks":42317,"language":"Python","last_updated":"2026-07-28","license":"MIT","name":"pytorch-lightning","publisher":"NousResearch","stars":221503},"relations":{"similar":[{"id":"synthetic-sciences/openscience/pytorch-lightning"},{"id":"OpenLAIR/dr-claw/pytorch-lightning"},{"id":"Orchestra-Research/AI-Research-SKILLs/pytorch-lightning"},{"id":"foryourhealth111-pixel/Vibe-Skills/pytorch-lightning"},{"id":"LeonChaoX/qinyan-academic-skills/pytorch-lightning"},{"id":"drshailesh88/integrated_content_OS/pytorch-lightning"},{"id":"K-Dense-AI/scientific-agent-skills/pytorch-lightning"},{"id":"Orchestra-Research/AI-Research-SKILLs/swanlab"},{"id":"travisjneuman/.claude/ai-ml-development"},{"id":"foryourhealth111-pixel/Vibe-Skills/weights-and-biases"}]},"slug":{"owner":"NousResearch","repo":"hermes-agent","skill":"pytorch-lightning"},"version":"a46410e9"}