livekit-plugins-assemblyai

What it is and what it does

This package is a plugin that connects AssemblyAI's speech-to-text service to the LiveKit Agents framework. It allows you to build real-time voice agents that can listen to and understand spoken input from users in WebRTC sessions. The plugin handles the integration between LiveKit's agent runtime and AssemblyAI's STT API, so you can focus on building the agent logic rather than managing the speech recognition plumbing.

The plugin is designed to work alongside other LiveKit Agents components—LLMs, TTS providers, and VAD (voice activity detection)—as part of a complete conversational agent pipeline. It requires only livekit-agents as a runtime dependency and integrates into the standard AgentSession workflow, making it straightforward to swap in or out depending on your STT provider preference.

Use it for:

• Building a customer service voice agent that understands caller speech in real time
• Creating a multi-turn conversational AI that listens and responds without manual transcription setup
• Integrating AssemblyAI's STT into an existing LiveKit WebRTC application for voice input
• Testing and prototyping voice agent behavior with AssemblyAI as the speech recognition backbone

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Integrates AssemblyAI speech-to-text into the LiveKit Agents framework for building real-time voice agents.

Yes, if you are building voice agents with LiveKit and prefer AssemblyAI as your speech-to-text provider. The package is actively maintained, has no known vulnerabilities, installs with low friction, and integrates cleanly into the LiveKit Agents ecosystem. Install it as part of your agent dependencies when you want AssemblyAI STT rather than another provider.

Install

livekit-plugins-assemblyai on PyPI

pip install livekit-plugins-assemblyai

uv add livekit-plugins-assemblyai

poetry add livekit-plugins-assemblyai

Installing livekit-plugins-assemblyai

Before you install

Low friction installation as a pure Python wheel. Actively maintained with a recent release and strong repository signal (13003 stars, last commit 2026-08-14).

License in practice

Apache-2.0 permissive license allows commercial and private use with minimal restrictions.

Quickstart

pip install livekit-plugins-assemblyai

from livekit.plugins import assemblyai
from livekit.agents import AgentSession

session = AgentSession(
    stt=assemblyai.STT(),
    # ... other session config
)

Requires Python 3.10 or later. AssemblyAI API credentials must be configured (typically via environment variables).

Verify before relying

• Whether AssemblyAI credentials are auto-discovered from environment or require explicit configuration
• Supported AssemblyAI STT models and language coverage beyond the base integration
• Real-time latency characteristics and streaming vs. batch processing behavior

Package facts

Evidence: livekit_plugins_assemblyai-1.6.10-py3-none-any.whl

Keywords: ai, audio, livekit, realtime, video, voice, webrtc

Tags

More Artificial Intelligence packages

Further reading