{"categories":[{"label":"Monitoring","url":"https://skillfed.io/packages/category/system-monitoring/3"}],"enrichment":{"capability":"Perf Analyzer is a CLI tool that measures and optimizes inference performance on Triton Inference Server by testing different optimization strategies under controlled load conditions.","skillfed_tags":["inference-benchmarking","triton-ecosystem","performance-profiling"],"use_cases":["Benchmark latency and throughput of a model before and after applying optimization techniques.","Profile ensemble or sequence models to identify which component is the performance bottleneck.","Validate that model changes (quantization, batching, etc.) actually improve end-to-end inference speed.","Load-test a Triton deployment to find the maximum sustainable request rate or concurrency.","Compare inference performance across different hardware or Triton configurations."],"what_it_does":"Perf Analyzer is a command-line benchmarking tool for Triton Inference Server that measures model inference performance under realistic load. It supports multiple load modes (concurrency, request rate, custom intervals) and measurement strategies (time windows, count windows) to help developers identify performance bottlenecks and validate optimization changes. The tool works with standard models, sequence models, ensemble models, and decoupled models, and can auto-generate or accept custom input data for testing.\n\nYou run it against a live Triton server to collect latency, throughput, and other performance metrics as you adjust model configurations or server settings. It's designed for iterative optimization workflows where you need to measure the impact of each change before moving to the next experiment.","worth_installing":"Yes, if you are actively optimizing models on Triton Inference Server and need a structured way to measure performance changes. The tool is actively maintained, has no runtime dependencies, and directly addresses the workflow of iterative model tuning. However, verify the unclear license terms first, and note that it requires an external Triton server to be useful\u2014it is not a standalone profiler."},"id":"perf-analyzer","links":{"html":"https://skillfed.io/packages/perf-analyzer","md":"https://skillfed.io/packages/perf-analyzer.md","pypi":"https://pypi.org/project/perf-analyzer/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-04-28","license_spdx":null,"license_treatment":"unclear","name":"perf-analyzer","python_support":"unspecified","summary":"Triton Performance Analyzer"},"popularity":{"monthly_downloads":434444,"position":6689,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"2.60.0"}