---
id: llama-stack-client
version: "0.7.5"
license: MIT
license_treatment: permissive
maintenance: active
---

# llama-stack-client — The official Python library for the llama-stack-client API

License: permissive · Maintenance: active · Downloads: 96.5K/mo

## What it is and what it does

llama-stack-client is a Python SDK generated by Stainless that wraps the Llama Stack REST API. It provides both synchronous and asynchronous clients powered by httpx, with full type hints for all request parameters and response objects. The library handles authentication via API keys, supports streaming responses using Server-Sent Events, and includes automatic pagination for list endpoints.

The package is designed for developers building applications that need to interact with a running Llama Stack server—querying available models, making chat completions, or accessing other inference capabilities. It includes a CLI tool for direct server interaction and supports optional aiohttp backend for improved async concurrency. Type definitions enable IDE autocomplete and early error detection, while Pydantic models provide helper methods for JSON serialization and dictionary conversion.

Use it for:

- Build a Python application that queries available models and makes chat completion requests to a Llama Stack server
- Stream inference responses in real-time from Llama models using Server-Sent Events within a web service
- Automate batch inference tasks asynchronously with the AsyncLlamaStackClient for concurrent model queries
- Integrate Llama Stack inference into a CLI tool using the bundled llama-stack-client command-line interface
- Paginate through large result sets automatically when listing models or other resources without manual page handling

## Worth the install?

AI-flagged interpretation of the facts above — verify before relying.

Python client library for interacting with Llama Stack REST API, providing type-safe synchronous and asynchronous access to inference, chat, and model management endpoints.

Yes, if you are building against a Llama Stack server. The library is actively maintained, has low install friction, carries no known vulnerabilities, and provides a well-typed interface with both sync and async support. The Python 3.12+ requirement is a hard constraint; if your project targets earlier versions, you cannot use this package. The pre-release status (--pre flag required) suggests API stability may still be evolving.

## Install

pip install llama-stack-client
uv add llama-stack-client
poetry add llama-stack-client

## Installing llama-stack-client

Before you install: Low install friction with a pure-Python wheel distribution. Active maintenance with recent releases (18 days since last update). Requires Python 3.12+, which narrows compatibility to modern environments.

License in practice: MIT license permits commercial and private use with minimal restrictions. You may use, modify, and distribute this library freely provided you include the license notice.

Quickstart:

pip install --pre llama_stack_client

from llama_stack_client import LlamaStackClient

client = LlamaStackClient()
models = client.models.list()

Requires Python 3.12 or later. Llama Stack server must be running and accessible at the configured endpoint.

Verify before relying:

- Whether the library works with Llama Stack server versions other than the current release
- Performance characteristics under high concurrency with the default httpx backend versus aiohttp
- Stability of the pre-release version tag (--pre flag required for installation)

## Package facts

- License: MIT (permissive)
- Python support: supports_current
- Install friction: low
- Maintenance: active
- Downloads: 96.5K/month (top 15,000 on PyPI)
- Known vulnerabilities: none known

## Tags

llama stack python client, llama api python sdk, llama inference client library, llama chat completion api, llama models python wrapper, llama stack rest api client, llama async python client, llama-inference, rest-api-client, async-support

[View on SkillFed](https://skillfed.io/packages/llama-stack-client) · [View on PyPI](https://pypi.org/project/llama-stack-client/)