{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/9"}],"enrichment":{"capability":"Provides Python bindings for NVIDIA TensorRT, a deep learning inference library that compiles and optimizes neural network models for deployment on NVIDIA GPUs.","skillfed_tags":["gpu-inference","model-optimization","nvidia-cuda"],"use_cases":["Compile ONNX or PyTorch models into optimized TensorRT engines for low-latency GPU inference in production","Deploy large language models or vision models on NVIDIA data center GPUs with reduced memory and latency","Benchmark and profile inference performance of neural networks on specific GPU hardware","Integrate model optimization into CI/CD pipelines for automated inference engine generation","Run inference on edge GPUs (Jetson devices) by leveraging TensorRT's memory-efficient compilation"],"what_it_does":"tensorrt-cu13 is NVIDIA's Python interface to TensorRT, a specialized inference engine that takes trained neural network models and optimizes them for execution on NVIDIA GPUs. It compiles models from frameworks like ONNX and PyTorch into optimized TensorRT engines, reducing latency and memory footprint during inference. The package depends on tensorrt_cu13_libs (the compiled runtime) and tensorrt_cu13_bindings (the Python API layer), making it a wrapper around NVIDIA's native libraries rather than a pure-Python implementation.\n\nThe library is designed for production inference workloads where speed and efficiency matter\u2014typical use cases include serving models in data centers, edge devices, or real-time applications. Version 11.2.1.2 represents a major release with breaking changes: weakly-typed networks, implicit quantization, and IPluginV2 plugins have been removed in favor of newer APIs. Installation requires CUDA 13 and a compatible GPU; it is not suitable for CPU-only environments.","worth_installing":"Yes, if you need to optimize neural network inference on NVIDIA GPUs and have CUDA 13 and compatible hardware available. High install friction and proprietary licensing require upfront setup and legal review, but the package is actively maintained, widely used (top 15000 PyPI), and has no known vulnerabilities. Not suitable for CPU-only or non-NVIDIA GPU environments."},"id":"tensorrt-cu13","links":{"html":"https://skillfed.io/packages/tensorrt-cu13","md":"https://skillfed.io/packages/tensorrt-cu13.md","pypi":"https://pypi.org/project/tensorrt-cu13/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-07-30","license_spdx":null,"license_treatment":"unclear","name":"tensorrt-cu13","python_support":"supports_current","summary":"A high performance deep learning inference library"},"popularity":{"monthly_downloads":135501,"position":11427,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"11.2.1.2"}
