{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/8"}],"enrichment":{"capability":"Provides evaluation components and CLI commands for the NVIDIA NeMo Agent Toolkit, enabling assessment of agent performance.","skillfed_tags":["agent-evaluation","nemo-toolkit","rag-systems"],"use_cases":["Evaluate agent response quality in RAG-based systems during development","Run CLI-based evaluation workflows as part of agent testing pipelines","Assess agent behavior and performance metrics during iteration","Integrate evaluation checks into validation workflows"],"what_it_does":"nvidia-nat-eval is a subpackage of the NVIDIA NeMo Agent Toolkit that adds evaluation capabilities for testing and assessing agent systems. It provides evaluation-specific components accessible through the nat.plugins.eval namespace, along with command-line tools for running evaluations. The package depends on nvidia-nat-atif as its sole runtime dependency.\n\nThis package targets developers building or testing AI agents, particularly those using retrieval-augmented generation patterns. It supports Python 3.11, 3.12, and 3.13, with active maintenance as of August 2026.","worth_installing":"Yes, if you are building or testing agents within the NVIDIA NeMo Agent Toolkit ecosystem. The package has low install friction, active maintenance, permissive licensing, and no known vulnerabilities. Install only if you need evaluation capabilities; it is a specialized subpackage."},"id":"nvidia-nat-eval","links":{"html":"https://skillfed.io/packages/nvidia-nat-eval","md":"https://skillfed.io/packages/nvidia-nat-eval.md","pypi":"https://pypi.org/project/nvidia-nat-eval/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-06-17","license_spdx":null,"license_treatment":"permissive","name":"nvidia-nat-eval","python_support":"supports_current","summary":"Subpackage for evaluation in NVIDIA NeMo Agent Toolkit"},"popularity":{"monthly_downloads":171435,"position":10366,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"1.8.0"}