{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/8"}],"enrichment":{"capability":"Transformer Engine accelerates Transformer model training and inference on NVIDIA GPUs using low-precision formats including FP8, MXFP8, and NVFP4 to reduce memory use and improve performance.","skillfed_tags":["gpu-acceleration","low-precision-training","transformer-optimization"],"use_cases":["Train large language models with reduced memory footprint using low-precision formats on Hopper or Blackwell GPUs.","Optimize inference latency for deployed Transformer models by leveraging low-precision computation and fused kernels.","Build mixture-of-experts or other advanced Transformer architectures with automatic mixed-precision support.","Integrate low-precision Transformer operations into custom deep learning frameworks via the C++ API.","Experiment with NVFP4 or MXFP8 formats on Blackwell hardware for training efficiency."],"what_it_does":"Transformer Engine is a library that accelerates Transformer model training and inference on NVIDIA GPUs by providing optimized low-precision computation. It supports FP8 on Hopper, Ada, and Ampere GPUs, and extends to MXFP8 and NVFP4 formats on Blackwell GPUs. The library automatically manages scaling factors and precision conversion, allowing users to enable low-precision training through a simple autocast API.\n\nThe package provides Python modules for building Transformer layers with built-in FP8 support and fused kernels for common operations. It integrates with popular frameworks and is designed to work with advanced training techniques like tensor parallelism, sequence parallelism, and mixture-of-experts architectures. Installation requires a compatible NVIDIA GPU, CUDA 12.1 or later, cuDNN 9.3 or later, and a modern C++ compiler with C++17 support.","worth_installing":"Yes, if you have access to a compatible NVIDIA GPU (Hopper, Ada, Ampere, or Blackwell) and are training or deploying Transformer models where memory and compute efficiency matter. Low install friction, active maintenance, and zero runtime dependencies make adoption straightforward. Verify the license terms before use in proprietary projects, and confirm your GPU and CUDA versions meet the stated requirements."},"id":"transformer-engine","links":{"html":"https://skillfed.io/packages/transformer-engine","md":"https://skillfed.io/packages/transformer-engine.md","pypi":"https://pypi.org/project/transformer-engine/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-11","license_spdx":null,"license_treatment":"unclear","name":"transformer-engine","python_support":"supports_current","summary":"Transformer acceleration library"},"popularity":{"monthly_downloads":147015,"position":11084,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"2.18.0"}