---
id: sglang
version: "0.5.17"
license: Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION 1. Definitions. "License" shall mean the terms and conditions for… (full text in the JSON record)
license_treatment: permissive
maintenance: active
---

# sglang — SGLang is a fast serving framework for large language models and vision language models.

License: permissive · Maintenance: active · Popularity: top 1,000 on PyPI

## Install

pip install sglang
uv add sglang
poetry add sglang

## Description

<div align="center" id="sglangtop">
<img src="https://raw.githubusercontent.com/sgl-project/sglang/main/assets/logo.png" alt="logo" width="400" margin="10px"></img>

[![PyPI](https://img.shields.io/pypi/v/sglang)](https://pypi.org/project/sglang)
![PyPI - Downloads](https://static.pepy.tech/badge/sglang?period=month)
[![license](https://img.shields.io/github/license/sgl-project/sglang.svg)](https://github.com/sgl-project/sglang/tree/main/LICENSE)
[![issue resolution](https://img.shields.io/github/issues-closed-raw/sgl-project/sglang)](https://github.com/sgl-project/sglang/issues)
[![open issues](https://img.shields.io/github/issues-raw/sgl-project/sglang)](https://github.com/sgl-project/sglang/issues)
[![Ask DeepWiki](https://deepwiki.com/badge.svg)](https://deepwiki.com/sgl-project/sglang)

</div>

--------------------------------------------------------------------------------

<p align="center">
<a href="https://lmsys.org/blog/"><b>Blog</b></a> |
<a href="https://docs.sglang.io/"><b>Documentation</b></a> |
<a href="https://roadmap.sglang.io/"><b>Roadmap</b></a> |
<a href="https://slack.sglang.io/"><b>Join Slack</b></a> |
<a href="https://meet.sglang.io/"><b>Weekly Dev...

## AI interpretation — verify before relying

SGLang is a high-performance serving framework for large language models and multimodal models, delivering low-latency and high-throughput inference with features like RadixAttention prefix caching, speculative decoding, and structured outputs.

Verdict: SGLang is an actively maintained framework for production LLM serving with strong community engagement. Medium install friction due to 73 dependencies and compiled components is typical for high-performance inference. Apache 2.0 license is permissive. No known vulnerabilities. Best suited for teams deploying large models at scale on GPU infrastructure.

[View on SkillFed](https://skillfed.io/packages/sglang) · [View on PyPI](https://pypi.org/project/sglang/)