{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/5"}],"enrichment":{"capability":"NIXL provides Python bindings to accelerate point-to-point communications in AI inference frameworks, abstracting CPU and GPU memory alongside file, block, and object storage through a modular plugin architecture.","skillfed_tags":["gpu-communication","inference-optimization","distributed-ai"],"use_cases":["Accelerate tensor transfers between GPUs in multi-GPU inference deployments running NVIDIA Dynamo","Abstract GPU memory and storage operations to simplify distributed inference framework implementation","Benchmark and profile point-to-point communication performance in inference workloads using NIXLBench","Integrate custom storage backends (file, block, object store) into inference pipelines via NIXL's plugin architecture","Enable metadata coordination across distributed inference nodes using ETCD integration"],"what_it_does":"NIXL is a Python library that wraps NVIDIA's Inference Xfer Library, a C++ communication acceleration layer designed for distributed AI inference. It abstracts over different memory types (CPU, GPU) and storage backends (file, block, object store) through a plugin system, allowing inference frameworks like NVIDIA Dynamo to optimize data movement without reimplementing transport logic.\n\nThe package ships as a prebuilt wheel for Linux (Python 3.10\u20133.14, aarch64 and x86_64) with both CUDA 12 and CUDA 13 backends included; the correct backend is selected automatically at runtime based on the CUDA version reported by PyTorch. It depends on torch and numpy. Development is active, and the library is permissively licensed under MIT and Apache-2.0.","worth_installing":"Yes, if you are building or deploying distributed AI inference on Linux with PyTorch and need to optimize inter-GPU or GPU-storage communication. The permissive dual license, active maintenance, and prebuilt wheels for modern Python versions lower friction. No if you are on macOS, Windows, or not using inference frameworks that benefit from explicit communication acceleration."},"id":"nixl-cu13","links":{"html":"https://skillfed.io/packages/nixl-cu13","md":"https://skillfed.io/packages/nixl-cu13.md","pypi":"https://pypi.org/project/nixl-cu13/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-14","license_spdx":"MIT AND Apache-2.0","license_treatment":"permissive","name":"nixl-cu13","python_support":"supports_current","summary":"NIXL Python API"},"popularity":{"monthly_downloads":548871,"position":6058,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"1.4.0"}