llama-stack-client
The official Python library for the llama-stack-client API
Decision gist · record as of 2026-08-14
Yes, if you are building against a Llama Stack server. The library is actively maintained, has low install friction, carries no known vulnerabilities, and provides a well-typed interface with both sync and async support. The Python 3.12+ requirement is a hard constraint; if your project targets earlier versions, you cannot use this package. The pre-release status (--pre flag required) suggests API stability may still be evolving.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires Python 3.12 or later.
- Llama Stack server must be running and accessible at the configured endpoint.
- Low install friction with a pure-Python wheel distribution.
License · maintenance · safety
MIT (permissive) — MIT license permits commercial and private use with minimal restrictions. You may use, modify, and distribute this library freely provided you include the license notice.
last release 2026-07-27 (18 days) · last repo commit 2026-07-17 · 197 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 96,452 downloads/mo, #13,211 on PyPI
Alternatives
Verify before relying
pip install --pre llama_stack_client
from llama_stack_client import LlamaStackClient
client = LlamaStackClient()
models = client.models.list()- Whether the library works with Llama Stack server versions other than the current release
- Performance characteristics under high concurrency with the default httpx backend versus aiohttp
- Stability of the pre-release version tag (--pre flag required for installation)
What it is and what it does
llama-stack-client is a Python SDK generated by Stainless that wraps the Llama Stack REST API. It provides both synchronous and asynchronous clients powered by httpx, with full type hints for all request parameters and response objects. The library handles authentication via API keys, supports streaming responses using Server-Sent Events, and includes automatic pagination for list endpoints.
The package is designed for developers building applications that need to interact with a running Llama Stack server—querying available models, making chat completions, or accessing other inference capabilities. It includes a CLI tool for direct server interaction and supports optional aiohttp backend for improved async concurrency. Type definitions enable IDE autocomplete and early error detection, while Pydantic models provide helper methods for JSON serialization and dictionary conversion.
Use it for
- Build a Python application that queries available models and makes chat completion requests to a Llama Stack server
- Stream inference responses in real-time from Llama models using Server-Sent Events within a web service
- Automate batch inference tasks asynchronously with the AsyncLlamaStackClient for concurrent model queries
- Integrate Llama Stack inference into a CLI tool using the bundled llama-stack-client command-line interface
- Paginate through large result sets automatically when listing models or other resources without manual page handling
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you are building against a Llama Stack server.
The library is actively maintained, has low install friction, carries no known vulnerabilities, and provides a well-typed interface with both sync and async support. The Python 3.12+ requirement is a hard constraint; if your project targets earlier versions, you cannot use this package. The pre-release status (--pre flag required) suggests API stability may still be evolving.
Install
llama-stack-client on PyPI
Before you install
Low install friction with a pure-Python wheel distribution. Active maintenance with recent releases (18 days since last update). Requires Python 3.12+, which narrows compatibility to modern environments.
Requires Python 3.12 or later. Llama Stack server must be running and accessible at the configured endpoint.
License in practice
MIT license permits commercial and private use with minimal restrictions. You may use, modify, and distribute this library freely provided you include the license notice.
Quickstart
pip install --pre llama_stack_client
from llama_stack_client import LlamaStackClient
client = LlamaStackClient()
models = client.models.list()Verify before relying
- Whether the library works with Llama Stack server versions other than the current release
- Performance characteristics under high concurrency with the default httpx backend versus aiohttp
- Stability of the pre-release version tag (--pre flag required for installation)
Package facts
| License | MIT permissive |
| Python support | Supports the current Python release >=3.12 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 15 packagesanyioclickdistrofirehttpxpandasprompt-toolkitpyamlpydanticrequestsrichsniffiotermcolortqdmtyping-extensions |
| Maintenance | Actively maintained 18 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 96,452 / month, #13,211 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Intended Audience :: DevelopersLicense :: OSI Approved :: MIT LicenseOperating System :: MacOSOperating System :: Microsoft :: WindowsOperating System :: OS IndependentOperating System :: POSIXOperating System :: POSIX :: LinuxProgramming Language :: Python :: 3.12Programming Language :: Python :: 3.14Topic :: Software Development :: Libraries :: Python ModulesTyping :: Typed |
Evidence: llama_stack_client-0.7.5-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “llama stack python client”
- llama-stack-clientPython client library for interacting with Llama Stack REST API,…
- llama-api-clientProvides a typed Python client for the Llama API with support for…
- ogx_open_clientProvides an OpenAPI-generated Python client for the OGX API, offering…
Give your agent the search over MCP, or paste the wish link into any chat.
More Python Modules packages
Converts domain names between Unicode and ASCII-compatible encoding (Punycode) according to IDNA 2008 and Unicode Technical Standard 46, with security validation and broader script coverage than the standard library.
Install it if you work with internationalized domain names, need to validate domains, or use HTTP clients that depend on it transitively.
Setuptools is a Python build backend and package management tool that handles building, distributing, and installing Python packages, including support for C/C++ extension modules.
PyYAML parses and emits YAML 1.1 data format, enabling serialization and deserialization of configuration files and Python objects to and from human-readable YAML text.
Pydantic validates Python data structures against type hints, coercing and checking input at runtime to ensure it matches a declared schema.
Provides reusable metadata objects for use with PEP-593 `typing.Annotated` to express common constraints like bounds, collection sizes, and predicates on types.
Install it if you use or build libraries that need to express type constraints in a standardized, inspectable way—or if you want to annotate your own types with…
Provides runtime tools to inspect and introspect Python type annotations, enabling programmatic examination of type hints at execution time.
See also llama-api-client · llama-models · together · groq · openai · openlayer · composio-client · supermemory · sambanova · perplexityai