nvdlfw-inspect
Facilitates debugging convergence issues and testing new algorithms/recipes for training LLMs using Nvidia libraries.
Decision gist · record as of 2026-08-14
Yes, if you are actively debugging LLM training convergence issues with NVIDIA frameworks and can tolerate the aging maintenance status. The low install friction and permissive license make it a low-risk addition to a training pipeline. However, the limited repository activity (21 stars, last commit 2025-09-17) and aging status suggest this is not a heavily supported tool—verify compatibility with your specific framework versions before relying on it in production.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires PyTorch and PyYAML as runtime dependencies; intended for multi-GPU training workflows where initialization should occur once per rank.
- Low install friction with a pure-Python wheel.
- Maintenance status is aging—last commit was 2025-09-17 and the repository has only 21 stars, suggesting limited adoption and uncertain long-term support.
License · maintenance · safety
Apache2 (permissive) — Licensed under Apache2 (permissive), so you can use, modify, and distribute the package freely in both open and proprietary projects without viral obligations.
last release 2025-12-03 (254 days) · last repo commit 2025-09-17 · 21 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 147,382 downloads/mo, #11,067 on PyPI
Alternatives
Verify before relying
pip install nvdlfw-inspect
import nvdlfw_inspect.api as debug_api
debug_api.initialize(config_file="debug_config.yaml")
debug_api.log_tensor_stats(layer_name, tensor=weight, tensor_name="weight")- Whether the package is actively maintained beyond the initial release cycle given the aging status and limited repository activity.
- Real-world performance and stability when used with large-scale distributed training setups.
- Compatibility guarantees with specific versions of Transformer Engine, Megatron-LM, and NeMo.
What it is and what it does
nvdlfw-inspect is a debugging toolkit for NVIDIA's deep learning framework ecosystem, designed to help diagnose convergence issues and validate new training algorithms when using Transformer Engine, Megatron-LM, NeMo, or plain PyTorch models. It works by attaching instrumentation at the layer level—you define which layers to monitor via regex patterns in a YAML config file, then selectively enable debug features (like tensor statistics collection) only for those layers. This targeted approach avoids the overhead of instrumenting an entire model.
The package provides both generic APIs for framework-agnostic tensor inspection and namespace-scoped APIs for framework-specific behavior. You initialize it once in your training script, configure which features and layers you want to monitor, and then call APIs to log statistics like mean, standard deviation, and norms on activations, weights, and gradients. It's built for multi-GPU training and expects initialization on every rank.
Use it for
- Diagnosing why an LLM training run is not converging by inspecting weight and activation statistics across selected layers.
- Validating a new training algorithm or recipe by comparing tensor statistics before and after changes.
- Monitoring specific transformer layers (e.g., attention heads, feed-forward blocks) during distributed training without full-model instrumentation overhead.
- Collecting gradient flow statistics to detect vanishing or exploding gradients in deep models.
- Prototyping custom debug features by loading framework-specific feature directories alongside generic ones.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you are actively debugging LLM training convergence issues with NVIDIA frameworks and can tolerate the aging maintenance status.
The low install friction and permissive license make it a low-risk addition to a training pipeline. However, the limited repository activity (21 stars, last commit 2025-09-17) and aging status suggest this is not a heavily supported tool—verify compatibility with your specific framework versions before relying on it in production.
Install
nvdlfw-inspect on PyPI
Before you install
Low install friction with a pure-Python wheel. Maintenance status is aging—last commit was 2025-09-17 and the repository has only 21 stars, suggesting limited adoption and uncertain long-term support.
Requires PyTorch and PyYAML as runtime dependencies; intended for multi-GPU training workflows where initialization should occur once per rank.
License in practice
Licensed under Apache2 (permissive), so you can use, modify, and distribute the package freely in both open and proprietary projects without viral obligations.
Quickstart
pip install nvdlfw-inspect
import nvdlfw_inspect.api as debug_api
debug_api.initialize(config_file="debug_config.yaml")
debug_api.log_tensor_stats(layer_name, tensor=weight, tensor_name="weight")Verify before relying
- Whether the package is actively maintained beyond the initial release cycle given the aging status and limited repository activity.
- Real-world performance and stability when used with large-scale distributed training setups.
- Compatibility guarantees with specific versions of Transformer Engine, Megatron-LM, and NeMo.
Package facts
| License | Apache2 permissive |
| Python support | Supports the current Python release >=3.8 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 2 packagespyyamltorch |
| Maintenance | Aging 254 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 147,382 / month, #11,067 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Development Status :: 4 - BetaOperating System :: OS IndependentProgramming Language :: Python :: 3Programming Language :: Python :: 3.6 |
Evidence: nvdlfw_inspect-0.2.2-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “llm training debugging”
- nvdlfw-inspectProvides debugging and instrumentation APIs for LLM training…
- mlflowMLflow is an open-source platform for managing the complete lifecycle…
- renderersConverts chat messages to token IDs for LLM inference and training,…
Give your agent the search over MCP, or paste the wish link into any chat.
More Artificial Intelligence packages
LiteLLM provides a unified Python interface to call 100+ LLM providers (OpenAI, Anthropic, Gemini, Bedrock, Azure, and others) using OpenAI-compatible API format, available as both a Python SDK and a self-hosted AI Gateway proxy server.
Install it if you need to work with multiple LLM providers or want to centralize LLM routing in your organization.
Client library and CLI tool for downloading, uploading, and managing models, datasets, and repositories on the Hugging Face Hub platform.
Install it if you work with Hugging Face Hub models or datasets.
LangChain provides a framework for building agents and LLM-powered applications by composing language models, tools, and memory through a unified API that abstracts over multiple model providers.
hf-xet provides chunk-based deduplication and efficient file transfer for the Hugging Face Hub, enabling faster uploads and downloads of large files with local disk caching.
Tokenizers converts raw text into token sequences for NLP models, with support for training custom vocabularies and using pre-built tokenizers (BPE, WordPiece) optimized for speed via Rust.
Transformers provides a unified framework for loading, fine-tuning, and running state-of-the-art pretrained models across text, vision, audio, video, and multimodal tasks using PyTorch, JAX, or TensorFlow.
Install it if you need to run or train any transformer-based model for NLP, vision, audio, or multimodal tasks.
See also nemo-toolkit · transformer-engine-cu13 · transformer-engine-cu12 · transformer-engine · megatron-core · nvidia-nat-opentelemetry · nvidia-nat-core · nvidia-nat-eval · nvidia-nvtx-cu11 · torch