{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/11"}],"enrichment":{"capability":"Accelerates Transformer model training and inference on NVIDIA GPUs using low-precision formats including FP8, MXFP8, and NVFP4, with optimized kernels and mixed-precision support.","skillfed_tags":["gpu-acceleration","mixed-precision","llm-training"],"use_cases":["Train large language models with FP8 precision to reduce memory footprint and training time on supported GPUs.","Integrate low-precision inference into production pipelines to serve models faster with lower latency.","Build mixture-of-experts models using optimized kernels for efficient sparse computation.","Experiment with NVFP4 format on Blackwell GPUs to achieve efficiency gains while maintaining precision.","Combine FP8 training with tensor or sequence parallelism for distributed training of large models."],"what_it_does":"Transformer Engine is a library that speeds up Transformer model training and inference on NVIDIA GPUs by using lower-precision arithmetic (FP8, MXFP8, NVFP4) instead of standard floating-point formats, reducing memory use and computation time. It provides modules for PyTorch and JAX/Flax that integrate FP8 support directly into Transformer layers, handling the scaling factors and precision conversions automatically. The library includes optimized C++ kernels and fused operations for common Transformer patterns, and works with advanced features like mixture-of-experts, tensor parallelism, and sequence parallelism.\n\nThe package targets researchers and engineers training or deploying large language models and multimodal Transformers on Hopper, Ada, Ampere, and Blackwell GPU architectures. It depends on packaging, pydantic, and importlib-metadata, and requires CUDA 12.1+ (12.8+ for Blackwell), cuDNN 9.3+, and Python 3.10+. Installation uses platform-specific wheels for x86_64 and aarch64 Linux.","worth_installing":"Yes, if you are training or deploying Transformer models on supported NVIDIA GPUs (Hopper, Ada, Ampere, or Blackwell) and want to reduce memory and compute cost. Verify the unclear license terms and ensure your CUDA/cuDNN versions meet the minimum requirements (12.1+ CUDA, 9.3+ cuDNN). No known vulnerabilities. Active maintenance and recent release are positive signals."},"id":"transformer-engine-cu13","links":{"html":"https://skillfed.io/packages/transformer-engine-cu13","md":"https://skillfed.io/packages/transformer-engine-cu13.md","pypi":"https://pypi.org/project/transformer-engine-cu13/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-11","license_spdx":null,"license_treatment":"unclear","name":"transformer-engine-cu13","python_support":"supports_current","summary":"Transformer acceleration library"},"popularity":{"monthly_downloads":81041,"position":14255,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"2.18.0"}