{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/8"}],"enrichment":{"capability":"sgl-kernel provides optimized CUDA compute primitives for LLM inference, enabling efficient execution of custom kernel operations for large language models and vision-language models.","skillfed_tags":["cuda-kernels","llm-inference","gpu-acceleration"],"use_cases":["Accelerate matrix operations in custom LLM inference engines by replacing generic CUDA kernels with optimized primitives.","Build vision-language model inference pipelines that require specialized compute kernels for efficient token processing.","Integrate into SGLang or LightLLM deployments to improve throughput and latency of model serving.","Develop custom LLM serving frameworks that need fine-grained control over GPU compute without writing raw CUDA code."],"what_it_does":"sgl-kernel is a compiled CUDA kernel library designed to accelerate large language model inference by providing optimized compute primitives. It exposes custom kernel operations that LLM inference engines like SGLang and LightLLM use to speed up matrix operations and other compute-intensive tasks during model execution. The package ships as pre-built wheels for x86_64 and aarch64 architectures, requiring Python \u22653.10 and torch == 2.9.1.\n\nThe library is intended for developers building or extending LLM inference systems who need lower-level kernel control and optimization. It has no Python runtime dependencies beyond torch, making it a thin wrapper around CUDA code. Installation is straightforward via pip, though the strict torch version requirement means you must align your environment carefully. The project is actively maintained with recent commits and has accumulated significant adoption in the LLM inference ecosystem.","worth_installing":"Yes, if you are building or extending an LLM inference engine and your environment uses torch == 2.9.1. The library is actively maintained, has no Python runtime dependencies, and is already proven in production LLM systems. The strict torch version requirement is a real constraint\u2014verify compatibility before committing. No known security vulnerabilities."},"id":"sgl-kernel","links":{"html":"https://skillfed.io/packages/sgl-kernel","md":"https://skillfed.io/packages/sgl-kernel.md","pypi":"https://pypi.org/project/sgl-kernel/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-01-14","license_spdx":null,"license_treatment":"permissive","name":"sgl-kernel","python_support":"supports_current","summary":"Kernel Library for SGLang"},"popularity":{"monthly_downloads":162742,"position":10590,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"0.3.21"}