libkvikio-cu12

What it is and what it does

libkvikio-cu12 is a Python wrapper around NVIDIA's cuFile C++ library that accelerates file I/O operations on GPU memory. It enables direct transfers between GPU device memory and storage without staging through host RAM, a capability known as GPUDirect Storage (GDS). The library also works efficiently when GDS is unavailable, transparently handling reads and writes to both host and device memory.

The package is designed for data-intensive GPU workloads—particularly in scientific computing and data analytics—where moving large arrays to and from disk is a bottleneck. It provides a Python API with context managers and non-blocking operations via an internal thread pool, plus a Zarr backend for seamless GPU data serialization. Installation requires cuda-toolkit, cuda-pathfinder, nvidia-cufile-cu12, and rapids-logger.

Use it for:

• Accelerate data loading pipelines that move large arrays directly into GPU memory without host RAM staging.
• Implement high-throughput concurrent reads and writes using the internal thread pool for data-intensive workloads.
• Serialize and deserialize GPU arrays to file efficiently using the Zarr backend for checkpoint operations.
• Build GPU-native data processing pipelines where file I/O latency is a critical performance bottleneck.
• Enable seamless host–device memory I/O in scientific computing applications without explicit memory transfers.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

libkvikio-cu12 provides Python and C++ bindings to NVIDIA's cuFile API, enabling high-performance GPU-accelerated file I/O with support for GPUDirect Storage and seamless host/device memory handling.

Yes, if you have an NVIDIA GPU and need to move large arrays between device memory and disk. The medium install friction (CUDA toolkit and cuFile dependency) is justified by the performance gains in GPU-accelerated workloads. Active maintenance, permissive Apache-2.0 license, and zero known vulnerabilities support adoption. Not suitable for CPU-only environments.

Install

libkvikio-cu12 on PyPI

pip install libkvikio-cu12

uv add libkvikio-cu12

poetry add libkvikio-cu12

Installing libkvikio-cu12

Before you install

Medium install friction due to CUDA toolkit and GPU-specific dependencies (cuda-pathfinder, cuda-toolkit, nvidia-cufile-cu12). Active maintenance with recent releases; repository is current and well-maintained.

License in practice

Apache-2.0 permissive license allows commercial and private use with minimal restrictions; suitable for most deployment scenarios.

Quickstart

pip install libkvikio-cu12

# Requires GPU array library and file I/O operations
# See documentation at https://docs.rapids.ai/api/kvikio/nightly/

Requires NVIDIA GPU, CUDA toolkit, and cuFile library (nvidia-cufile-cu12) installed and properly configured.

Verify before relying

• Whether rapids-logger is a hard runtime requirement or optional dependency for logging.
• Exact Python version support (classifiers list 3.11–3.14 but requires_python is unspecified).
• Performance gains over standard file I/O in typical workloads and memory configurations.
• Specific usage patterns and API surface beyond what the description excerpt demonstrates.

Package facts

Evidence: libkvikio_cu12-26.8.0-py3-none-manylinux_2_28_aarch64.whl; libkvikio_cu12-26.8.0-py3-none-manylinux_2_28_x86_64.whl

Tags

More Scientific/Engineering packages

Further reading