{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/4"}],"enrichment":{"capability":"sglang-kernel provides optimized CUDA compute primitives for LLM inference engines, enabling efficient inference for large language models and vision-language models through custom kernel operations.","skillfed_tags":["cuda-kernels","llm-inference","gpu-acceleration"],"use_cases":["Accelerate batch matrix multiplication and attention operations in LLM inference engines","Optimize vision-language model inference by providing specialized CUDA kernels for image and token processing","Reduce latency and increase throughput in production LLM serving systems that depend on custom kernel performance","Integrate with PyTorch-based inference frameworks that need fine-grained control over GPU compute primitives"],"what_it_does":"sglang-kernel is a library of hand-optimized CUDA kernels designed to accelerate inference for large language models and vision-language models. It provides custom compute primitives that integrate with PyTorch, allowing LLM inference engines to execute critical operations more efficiently on NVIDIA GPUs.\n\nThe package is distributed as pre-compiled wheels for x86_64 and aarch64 architectures, with no runtime Python dependencies. It requires torch == 2.13.0 and Python \u22653.10, and is intended to be used as a low-level acceleration layer within larger inference frameworks rather than as a standalone application. The source code lives in the sglang project repository.","worth_installing":"Yes, if you are building or deploying an LLM inference engine that benefits from custom CUDA kernels and you have torch == 2.13.0 and Python \u22653.10 available. The active maintenance, permissive license, and high repository engagement suggest solid backing. Install friction is moderate due to compiled wheels, but no runtime dependencies simplify integration. Not suitable as a standalone package; it is a dependency for inference frameworks."},"id":"sglang-kernel","links":{"html":"https://skillfed.io/packages/sglang-kernel","md":"https://skillfed.io/packages/sglang-kernel.md","pypi":"https://pypi.org/project/sglang-kernel/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-06","license_spdx":null,"license_treatment":"permissive","name":"sglang-kernel","python_support":"supports_current","summary":"Kernel Library for SGLang"},"popularity":{"monthly_downloads":643262,"position":5608,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"0.4.6.post1"}