{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/8"}],"enrichment":{"capability":"Provides debugging and instrumentation APIs for LLM training workflows using NVIDIA libraries (Transformer Engine, Megatron-LM, NeMo) and PyTorch models, with configurable layer-level feature selection and tensor statistics collection.","skillfed_tags":["llm-debugging","distributed-training","nvidia-ecosystem"],"use_cases":["Diagnosing why an LLM training run is not converging by inspecting weight and activation statistics across selected layers.","Validating a new training algorithm or recipe by comparing tensor statistics before and after changes.","Monitoring specific transformer layers (e.g., attention heads, feed-forward blocks) during distributed training without full-model instrumentation overhead.","Collecting gradient flow statistics to detect vanishing or exploding gradients in deep models.","Prototyping custom debug features by loading framework-specific feature directories alongside generic ones."],"what_it_does":"nvdlfw-inspect is a debugging toolkit for NVIDIA's deep learning framework ecosystem, designed to help diagnose convergence issues and validate new training algorithms when using Transformer Engine, Megatron-LM, NeMo, or plain PyTorch models. It works by attaching instrumentation at the layer level\u2014you define which layers to monitor via regex patterns in a YAML config file, then selectively enable debug features (like tensor statistics collection) only for those layers. This targeted approach avoids the overhead of instrumenting an entire model.\n\nThe package provides both generic APIs for framework-agnostic tensor inspection and namespace-scoped APIs for framework-specific behavior. You initialize it once in your training script, configure which features and layers you want to monitor, and then call APIs to log statistics like mean, standard deviation, and norms on activations, weights, and gradients. It's built for multi-GPU training and expects initialization on every rank.","worth_installing":"Yes, if you are actively debugging LLM training convergence issues with NVIDIA frameworks and can tolerate the aging maintenance status. The low install friction and permissive license make it a low-risk addition to a training pipeline. However, the limited repository activity (21 stars, last commit 2025-09-17) and aging status suggest this is not a heavily supported tool\u2014verify compatibility with your specific framework versions before relying on it in production."},"id":"nvdlfw-inspect","links":{"html":"https://skillfed.io/packages/nvdlfw-inspect","md":"https://skillfed.io/packages/nvdlfw-inspect.md","pypi":"https://pypi.org/project/nvdlfw-inspect/"},"maintenance":{"status":"aging"},"meta":{"latest_release":"2025-12-03","license_spdx":null,"license_treatment":"permissive","name":"nvdlfw-inspect","python_support":"supports_current","summary":"Facilitates debugging convergence issues and testing new algorithms/recipes for training LLMs using Nvidia libraries."},"popularity":{"monthly_downloads":147382,"position":11067,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"0.2.2"}