{"enrichment":{"faq":[{"a":"llm-fine-tuning provides end-to-end infrastructure for fine-tuning Llama 3 and other open-source LLMs on custom datasets. Start by setting up LoRA or QLoRA adapters depending on your GPU memory constraints. For consumer hardware, QLoRA enables 4-bit quantization to fit large models on a single GPU. Use Axolotl framework configuration to define your dataset, model, and training hyperparameters, then launch training. After completion, merge adapters back into the base model for deployment.","q":"How do I fine-tune Llama 3 on my own data with llm-fine-tuning?"},{"a":"llm-fine-tuning supports QLoRA, which combines 4-bit quantization with LoRA (Low-Rank Adaptation) to fine-tune large models like 70B parameter models on a single consumer GPU. QLoRA quantizes the base model to 4-bit precision while keeping trainable low-rank adapter weights in full precision. This dramatically reduces memory usage compared to full fine-tuning, making it practical for resource-constrained environments while maintaining competitive performance.","q":"What is QLoRA fine-tuning and how does it work on a single GPU?"},{"a":"llm-fine-tuning enables distributed training through DeepSpeed ZeRO optimization and FSDP (Fully Sharded Data Parallel). Configure your Axolotl training config to specify DeepSpeed ZeRO stages (1, 2, or 3) or FSDP settings. ZeRO-3 shards model parameters, gradients, and optimizer states across GPUs for maximum memory efficiency on large models. FSDP offers similar functionality with PyTorch native support. Both approaches scale training across multiple GPUs or nodes for faster convergence on large datasets.","q":"How do I configure distributed multi-GPU training with DeepSpeed or FSDP?"},{"a":"llm-fine-tuning implements RLHF (Reinforcement Learning from Human Feedback), DPO (Direct Preference Optimization), and instruction-tuning pipelines for model alignment. DPO provides a simpler alternative to RLHF by directly optimizing for preferred outputs without a separate reward model. Instruction-tuning formats your data as instruction-response pairs to improve task-following behavior. Configure your alignment approach in Axolotl with appropriate loss functions and data formatting.","q":"What alignment methods does llm-fine-tuning support for model training?"},{"a":"llm-fine-tuning provides utilities to merge trained LoRA adapters back into the base model for production deployment. After training completes, use the merge function to combine adapter weights with the original model. Export the merged model in standard formats compatible with vLLM inference engine. This unified model can then be deployed for low-latency serving without requiring separate adapter loading during inference.","q":"How do I export and merge LoRA adapters for production serving with vLLM?"},{"a":"llm-fine-tuning supports sample packing to combine multiple short sequences into single training examples, reducing padding overhead and improving GPU utilization. Flash Attention integration accelerates attention computation during training. Prepare datasets in standard formats (JSONL, Parquet, or HuggingFace datasets) and configure preprocessing in Axolotl. These optimizations together reduce training time and memory consumption while maintaining model quality.","q":"What dataset preparation and efficiency optimizations are included?"}],"shadow_tags":["parameter-efficient-tuning","quantization-aware-training","distributed-gpu-orchestration","model-adaptation-framework","inference-optimization","preference-alignment","production-deployment-ready","memory-constrained-training","multi-node-scaling"],"summary_rewrite":"Configure end-to-end LLM fine-tuning from single-GPU LoRA to multi-node distributed training. This skill covers QLoRA quantization for large models on consumer hardware, Axolotl framework setup, DeepSpeed ZeRO optimization, DPO alignment, and adapter merging for production deployment."},"files":[{"bytes":8810,"path":"infrastructure/local-ai/llm-fine-tuning/SKILL.md","sha256":"f8202fe5cea1832b002c95098196dd180a343fdca94139a8fb9b7ef3fb62585d","url":"https://skillfed.io/files/BagelHole/DevOps-Security-Agent-Skills/llm-fine-tuning/1e690e66/SKILL.md"}],"id":"BagelHole/DevOps-Security-Agent-Skills/llm-fine-tuning","links":{"html":"https://skillfed.io/BagelHole/DevOps-Security-Agent-Skills/llm-fine-tuning","md":"https://skillfed.io/BagelHole/DevOps-Security-Agent-Skills/llm-fine-tuning.md","repo":"https://github.com/BagelHole/DevOps-Security-Agent-Skills"},"meta":{"agents_supported":[],"first_seen":"2026-07-28","forks":4,"language":"Shell","last_updated":"2026-05-22","license":"MIT","name":"llm-fine-tuning","publisher":"BagelHole","stars":44},"relations":{"similar":[{"id":"NousResearch/hermes-agent/peft"},{"id":"synthetic-sciences/openscience/peft"},{"id":"OpenRaiser/NanoResearch/peft"},{"id":"OpenLAIR/dr-claw/peft"},{"id":"Orchestra-Research/AI-Research-SKILLs/peft"},{"id":"graniet/kheish/peft"},{"id":"JosiahSiegel/claude-plugin-marketplace/ml-fine-tuning"},{"id":"synthetic-sciences/openscience/unsloth"},{"id":"Jeffallan/claude-skills/fine-tuning-expert"},{"id":"synthetic-sciences/openscience/trl-fine-tuning"}]},"slug":{"owner":"BagelHole","repo":"DevOps-Security-Agent-Skills","skill":"llm-fine-tuning"},"version":"1e690e66"}