---
id: pipecat-ai
version: "1.7.0"
license: BSD-2-Clause
license_treatment: permissive
maintenance: active
---

# pipecat-ai — An open source framework for voice (and multimodal) assistants

License: permissive · Maintenance: active · Downloads: 1.2M/mo

## What it is and what it does

Pipecat is a framework for building conversational AI agents that handle voice and video in real-time. It abstracts the complexity of orchestrating speech recognition, text-to-speech, LLM calls, and media transport so you can focus on agent logic. The framework supports single agents or multi-agent systems where agents can hand off work, run in parallel, or coordinate over a shared bus—all on a single machine or distributed across processes and servers.

You compose agents from modular pipeline components: audio/video sources, AI services (speech-to-text, language models, text-to-speech), and transports (WebSocket, WebRTC). The framework handles streaming, buffering, and synchronization. It integrates with services like OpenAI and supports pluggable backends for speech and LLM providers. The ecosystem includes client SDKs for web and mobile, a CLI for scaffolding and deployment, and debugging tools.

Use it for:

- Build voice assistants with natural streaming conversations, speech recognition, and real-time text-to-speech responses.
- Create multi-agent systems where specialist agents hand off tasks, fan out in parallel, or run as sidecars coordinating over a shared bus.
- Develop AI companions (coaches, meeting assistants, characters) with voice and video interaction.
- Build business agents for customer intake, support bots, or guided conversation flows.
- Create interactive storytelling or creative tools that generate voice and video responses.
- Design complex dialog systems with structured conversation paths and state management using Pipecat Flows.

## Worth the install?

AI-flagged interpretation of the facts above — verify before relying.

Pipecat is a Python framework for building real-time voice and multimodal conversational AI agents, with support for orchestrating audio, video, AI services, and multi-agent coordination over shared buses or distributed systems.

Yes. Pipecat is actively maintained, permissively licensed, has low install friction, and solves a real problem (real-time multimodal agent orchestration) that would otherwise require gluing together many libraries. The 14k GitHub stars and recent release cycle signal maturity and community adoption. No known vulnerabilities. Install if you're building voice or multimodal agents; skip if you only need simple speech-to-text or text-to-speech without orchestration.

## Install

pip install pipecat-ai
uv add pipecat-ai
poetry add pipecat-ai

## Installing pipecat-ai

Before you install: Low install friction with a pure-Python wheel. Active maintenance with a recent release (13 days ago) and strong community engagement (14114 GitHub stars). Requires Python 3.11+. The 22 runtime dependencies are substantial but standard for audio/video/AI work (numpy, protobuf, onnxruntime, openai, websockets, etc.).

License in practice: BSD-2-Clause (permissive) allows commercial use, modification, and distribution with minimal restrictions—suitable for proprietary projects as long as you include the license and original copyright notice.

Quickstart:

pip install pipecat-ai

from pipecat.core.pipeline import Pipeline
from pipecat.services.openai import OpenAILLMService

# Build a simple voice agent pipeline
pipeline = Pipeline()
pipeline.add_service(OpenAILLMService())

Requires Python 3.11 or later. Some audio/video features may require system libraries (e.g., for audio encoding/decoding via onnxruntime and soxr).

Verify before relying:

- Whether all 22 runtime dependencies are required for basic voice agent use or if subsets are optional.
- Specific system-level audio/video codec requirements beyond Python packages.
- Real-world latency characteristics for different transport types (WebSocket vs WebRTC).
- Whether the framework supports local-only operation or requires cloud AI services.

## Package facts

- License: BSD-2-Clause (permissive)
- Python support: supports_current
- Install friction: low
- Maintenance: active
- Downloads: 1.2M/month (top 5,000 on PyPI)
- Known vulnerabilities: none known

## Tags

real-time voice ai agents, multimodal conversational ai framework, voice assistant framework, multi-agent ai orchestration, webrtc audio video ai, streaming speech recognition tts, ai agent pipeline framework, voice-ai, real-time-agents, multimodal

[View on SkillFed](https://skillfed.io/packages/pipecat-ai) · [View on PyPI](https://pypi.org/project/pipecat-ai/)