---
id: agent-framework-ollama
version: "1.0.0b260813"
license: unclear
license_treatment: permissive
maintenance: active
---

# agent-framework-ollama — Ollama integration for Microsoft Agent Framework.

License: permissive · Maintenance: active · Downloads: 485.2K/mo

## What it is and what it does

agent-framework-ollama is a provider plugin for Microsoft Agent Framework that allows agents to use Ollama as their language model backend. Ollama is an open-source system for running large language models locally or remotely, and this package bridges the two by implementing the necessary client interface so agents built with Agent Framework can delegate reasoning to Ollama-hosted models instead of requiring cloud-based providers like Azure OpenAI or OpenAI.

The package is part of the broader Agent Framework ecosystem, which is designed for production-grade multi-agent workflows. By using Ollama, developers can build agents with full control over model selection, deployment location, and data privacy—useful for on-premises deployments, cost-sensitive scenarios, or teams wanting to experiment with open-source models. The integration inherits Agent Framework's orchestration, middleware, and observability features, so agents using Ollama can still participate in complex workflows, multi-agent collaboration, and distributed tracing.

Use it for:

- Build a local AI agent for document analysis or code review that runs entirely on-premises without cloud API calls.
- Prototype multi-agent workflows using open-source models before committing to commercial LLM provider costs.
- Deploy agents in environments with strict data residency requirements where models must run on private infrastructure.
- Experiment with different open-source model architectures (Llama, Mistral, etc.) without rewriting agent code.
- Integrate Ollama-based agents into existing Agent Framework applications that already use other providers.

## Worth the install?

AI-flagged interpretation of the facts above — verify before relying.

Integrates Ollama LLM provider support into Microsoft Agent Framework, enabling agents to run local or remote Ollama models as their reasoning backbone.

Yes, if you are building agents with Microsoft Agent Framework and want to use Ollama as your model provider. The package has low install friction, active maintenance, no known vulnerabilities, and a permissive license. It is most valuable for teams prioritizing data privacy, cost control, or open-source model flexibility over cloud-provider convenience. If you are already committed to Agent Framework and Ollama, this is a straightforward addition; if you are still evaluating frameworks, verify that Ollama's model selection and performance meet your requirements.

## Install

pip install agent-framework-ollama
uv add agent-framework-ollama
poetry add agent-framework-ollama

## Installing agent-framework-ollama

Before you install: Low install friction with only two runtime dependencies (agent-framework-core and ollama). Package is actively maintained with a recent release and no known vulnerabilities.

License in practice: MIT license permits unrestricted use, modification, and distribution in both open-source and proprietary projects with minimal legal friction.

Quickstart:

pip install agent-framework-ollama

from agent_framework import Agent
from agent_framework_ollama import OllamaClient

agent = Agent(
    client=OllamaClient(model="llama2"),
    name="LocalAgent",
    instructions="You are a helpful assistant."
)

result = await agent.run("Your prompt here")

Requires Python 3.10 or later; Ollama server must be running and accessible at the configured endpoint.

Verify before relying:

- Whether this package works with specific Ollama model versions or has known compatibility constraints.
- Performance characteristics or latency expectations when using local vs. remote Ollama instances.
- Whether streaming, tool use, or other advanced Agent Framework features are fully supported through the Ollama provider.

## Package facts

- License: not declared (permissive)
- Python support: supports_current
- Install friction: low
- Maintenance: active
- Downloads: 485.2K/month (top 15,000 on PyPI)
- Known vulnerabilities: none known

## Tags

ollama agent framework integration, local llm agent support, ollama python agent, microsoft agent framework provider, open source model agents, llm-provider, multi-agent-framework, local-inference

[View on SkillFed](https://skillfed.io/packages/agent-framework-ollama) · [View on PyPI](https://pypi.org/project/agent-framework-ollama/)