{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/4"}],"enrichment":{"capability":"sgl-deep-gemm provides optimized GEMM (matrix multiplication) kernels for GPU acceleration, packaged as a PyPI-installable wheel with ABI compatibility across Python versions via apache-tvm-ffi.","skillfed_tags":["gpu-acceleration","matrix-operations","llm-inference"],"use_cases":["Accelerate matrix multiplication operations in SGLang-based LLM inference pipelines.","Deploy optimized GEMM kernels across multiple Python versions without rebuilding wheels.","Improve throughput for batch matrix operations on NVIDIA GPUs in production systems.","Integrate custom GPU kernels into neural network frameworks via TVM's FFI layer.","Support both x86_64 and aarch64 GPU deployments with a single wheel distribution."],"what_it_does":"sgl-deep-gemm is an SGLang-optimized fork of DeepGemm that provides GPU-accelerated matrix multiplication kernels for neural network inference and training workloads. It wraps custom GEMM implementations via apache-tvm-ffi to enable ABI-compatible wheels that work across different Python versions without recompilation, simplifying deployment compared to building from source.\n\nThe package is designed for use within SGLang's inference framework and targets NVIDIA GPUs on Linux (x86_64 and aarch64). Installation is straightforward via pip, but it requires Python 3.10 or later and a CUDA-capable GPU. The underlying kernels are optimized for specific tensor operations common in large language model inference.","worth_installing":"Yes, if you are using SGLang for LLM inference on NVIDIA GPUs and need optimized matrix multiplication. The active maintenance, permissive license, and ABI-compatible wheels make it low-friction to adopt. No, if you are not in the SGLang ecosystem or lack a compatible GPU and Linux platform (x86_64 or aarch64)."},"id":"sgl-deep-gemm","links":{"html":"https://skillfed.io/packages/sgl-deep-gemm","md":"https://skillfed.io/packages/sgl-deep-gemm.md","pypi":"https://pypi.org/project/sgl-deep-gemm/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-05","license_spdx":"Apache-2.0","license_treatment":"permissive","name":"sgl-deep-gemm","python_support":"supports_current","summary":"SGLang fork of DeepGemm"},"popularity":{"monthly_downloads":692839,"position":5319,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"0.1.5.post2"}