{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/10"}],"enrichment":{"capability":"Accelerates Transformer model training and inference on NVIDIA GPUs using low-precision formats (FP8, MXFP8, NVFP4) with optimized kernels and mixed-precision APIs.","skillfed_tags":["gpu-acceleration","low-precision-training","transformer-models"],"use_cases":["Train large language models with FP8 precision to reduce memory footprint and increase throughput without accuracy loss","Accelerate Mixture-of-Experts (MoE) model training using fused kernels and low-precision formats","Run inference on Transformer models with reduced latency and memory using optimized GPU kernels","Implement mixed-precision training workflows with automatic scaling factor management","Deploy multimodal or biology-focused Transformer models on Blackwell GPUs using NVFP4 for maximum efficiency"],"what_it_does":"Transformer Engine is a library that accelerates Transformer model training and inference on NVIDIA GPUs by providing optimized kernels and low-precision arithmetic support. It enables 8-bit floating-point (FP8) training on Hopper, Ada, and Ampere GPUs, and adds support for MXFP8 and NVFP4 formats on Blackwell GPUs. The library handles scaling factors and precision management internally, allowing developers to use a simple autocast API similar to mixed-precision training frameworks.\n\nThe package integrates with popular frameworks through framework-specific modules and provides a C++ API for integration with other deep learning libraries. It includes fused operations, support for distributed training patterns (tensor/sequence/context parallelism), and Mixture-of-Experts (MoE) optimizations. Installation requires a compatible NVIDIA GPU, CUDA 12.1+, cuDNN 9.3+, and a C++ compiler with C++17 support; wheels are pre-compiled for specific architectures (x86_64, aarch64) on manylinux_2_28.","worth_installing":"Yes, if you are training or serving Transformer models on supported NVIDIA GPUs (Ampere or newer) and have the required CUDA/cuDNN stack. The library is actively maintained, has no known vulnerabilities, and offers significant performance and memory benefits through low-precision training. However, verify license terms before commercial use and ensure your system meets the strict hardware and software prerequisites (CUDA 12.1+, cuDNN 9.3+, C++17 compiler)."},"id":"transformer-engine-cu12","links":{"html":"https://skillfed.io/packages/transformer-engine-cu12","md":"https://skillfed.io/packages/transformer-engine-cu12.md","pypi":"https://pypi.org/project/transformer-engine-cu12/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-11","license_spdx":null,"license_treatment":"unclear","name":"transformer-engine-cu12","python_support":"supports_current","summary":"Transformer acceleration library"},"popularity":{"monthly_downloads":95170,"position":13288,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"2.18.0"}