azure-ai-inference
Microsoft Azure AI Inference Client Library for Python
Decision gist · record as of 2026-08-14
Yes, with conditions. Install if you are building on Azure AI services and want a unified client across GitHub Models, Foundry, or Azure OpenAI—it eliminates provider-specific boilerplate. The library is actively maintained, has no known vulnerabilities, and uses a permissive MIT license. However, it is still in beta (1.0.0b9), so expect potential API changes before a stable release.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires Python 3.8 or later.
- Endpoint URL and credentials (API key, GitHub token, or Entra ID) must be provided; for Entra ID, azure-identity package must be installed separately.
- Low install friction with three lightweight runtime dependencies.
License · maintenance · safety
MIT License (permissive) — MIT License permits commercial and private use with minimal restrictions, making it suitable for production applications.
last release 2025-02-15 (545 days) · last repo commit 2026-08-14 · 5,588 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 5,834,617 downloads/mo, #2,029 on PyPI
Alternatives
Verify before relying
pip install azure-ai-inference
from azure.ai.inference import ChatCompletionsClient
from azure.core.credentials import AzureKeyCredential
client = ChatCompletionsClient(
endpoint="https://models.inference.ai.azure.com",
credential=AzureKeyCredential(github_token),
model="mistral-large"
)- Whether the REST API version 2024-05-01-preview is stable or subject to breaking changes before 1.0.0 GA.
- Performance characteristics and rate limits when comparing across GitHub Models, Serverless, and Azure OpenAI endpoints.
- Whether async support requires aiohttp as an optional dependency or if it is bundled.
What it is and what it does
Azure AI Inference is a Python client library that abstracts authentication and API calls to multiple AI model deployment services under a single interface. It supports GitHub Models (free-tier), Azure AI Foundry Serverless and Managed Compute endpoints, and Azure OpenAI Service, allowing developers to write inference code once and switch between providers or compare model performance without rewriting client logic.
The library provides ChatCompletionsClient and EmbeddingsClient classes for synchronous and asynchronous operations. It handles credential management via API keys, GitHub tokens, or Entra ID, and manages REST API versioning. Runtime dependencies are minimal (isodate, azure-core, typing-extensions), and the package is in beta but actively maintained with recent releases.
Use it for
- Compare inference quality across different AI models using identical Python code and a single client.
- Build applications on GitHub Models for prototyping, then migrate to Azure OpenAI or Foundry endpoints without rewriting client code.
- Implement chat completions or text embeddings against Azure AI Foundry deployments with automatic credential handling.
- Evaluate multiple model providers in A/B testing scenarios by swapping endpoints and credentials.
- Generate text embeddings from various Azure-hosted models for vector search or semantic similarity tasks.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, with conditions.
Install if you are building on Azure AI services and want a unified client across GitHub Models, Foundry, or Azure OpenAI—it eliminates provider-specific boilerplate. The library is actively maintained, has no known vulnerabilities, and uses a permissive MIT license. However, it is still in beta (1.0.0b9), so expect potential API changes before a stable release.
Install
azure-ai-inference on PyPI
Before you install
Low install friction with three lightweight runtime dependencies. Active maintenance with recent releases; last commit 2026-08-14. Beta status (Development Status :: 4) means the API surface may shift before a stable release.
Requires Python 3.8 or later. Endpoint URL and credentials (API key, GitHub token, or Entra ID) must be provided; for Entra ID, azure-identity package must be installed separately.
License in practice
MIT License permits commercial and private use with minimal restrictions, making it suitable for production applications.
Quickstart
pip install azure-ai-inference
from azure.ai.inference import ChatCompletionsClient
from azure.core.credentials import AzureKeyCredential
client = ChatCompletionsClient(
endpoint="https://models.inference.ai.azure.com",
credential=AzureKeyCredential(github_token),
model="mistral-large"
)Verify before relying
- Whether the REST API version 2024-05-01-preview is stable or subject to breaking changes before 1.0.0 GA.
- Performance characteristics and rate limits when comparing across GitHub Models, Serverless, and Azure OpenAI endpoints.
- Whether async support requires aiohttp as an optional dependency or if it is bundled.
Package facts
| License | MIT License permissive |
| Python support | Supports the current Python release >=3.8 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 3 packagesisodateazure-coretyping-extensions |
| Maintenance | Actively maintained 545 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 5,834,617 / month, #2,029 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Development Status :: 4 - BetaLicense :: OSI Approved :: MIT LicenseProgramming Language :: PythonProgramming Language :: Python :: 3Programming Language :: Python :: 3 :: OnlyProgramming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Programming Language :: Python :: 3.8Programming Language :: Python :: 3.9 |
Evidence: azure_ai_inference-1.0.0b9-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “azure ai inference client”
- azure-ai-inferenceUnified client library for chat completions, text embeddings, and…
- llm-github-modelsA plugin for the llm command-line tool that provides access to GitHub…
- azure-ai-projectsProvides a Python client for Microsoft Foundry projects, enabling…
Give your agent the search over MCP, or paste the wish link into any chat.
More Artificial Intelligence packages
LiteLLM provides a unified Python interface to call 100+ LLM providers (OpenAI, Anthropic, Gemini, Bedrock, Azure, and others) using OpenAI-compatible API format, available as both a Python SDK and a self-hosted AI Gateway proxy server.
Install it if you need to work with multiple LLM providers or want to centralize LLM routing in your organization.
Client library and CLI tool for downloading, uploading, and managing models, datasets, and repositories on the Hugging Face Hub platform.
Install it if you work with Hugging Face Hub models or datasets.
LangChain provides a framework for building agents and LLM-powered applications by composing language models, tools, and memory through a unified API that abstracts over multiple model providers.
hf-xet provides chunk-based deduplication and efficient file transfer for the Hugging Face Hub, enabling faster uploads and downloads of large files with local disk caching.
Tokenizers converts raw text into token sequences for NLP models, with support for training custom vocabularies and using pre-built tokenizers (BPE, WordPiece) optimized for speed via Rust.
Transformers provides a unified framework for loading, fine-tuning, and running state-of-the-art pretrained models across text, vision, audio, video, and multimodal tasks using PyTorch, JAX, or TensorFlow.
Install it if you need to run or train any transformer-based model for NLP, vision, audio, or multimodal tasks.
See also azure-ai-projects · foundry-local-sdk · azure-ai-vision-imageanalysis · azure-ai-language-questionanswering · azure-ai-agents · azure-ai-language-conversations · azure-ai-contentunderstanding · agent-framework-openai · azure-ai-documentintelligence · vastai-sdk