livekit-plugins-groq

What it is and what it does

This package is a plugin that connects Groq's inference API to the LiveKit Agents framework, allowing you to build real-time voice and conversational agents powered by Groq's LLM models. It acts as a bridge between LiveKit's agent orchestration layer and Groq's fast inference service, letting you swap in Groq as your LLM provider alongside other STT, TTS, and realtime API choices.

The plugin integrates into LiveKit's existing agent architecture, so you use it the same way you'd use any other LLM provider in the framework—by passing a Groq LLM instance to your AgentSession. It inherits all of LiveKit Agents' features: multi-agent handoff, function tools, semantic turn detection, and test framework support. The plugin is maintained as part of the main LiveKit Agents repository and released frequently.

Use it for:

• Build a voice assistant using Groq inference to reduce latency in real-time conversations.
• Create a multi-modal agent combining Groq LLM with LiveKit's STT and TTS for end-to-end voice interactions.
• Replace another LLM provider with Groq in an existing LiveKit agent without changing core logic.
• Deploy a telephony-integrated voice agent using LiveKit's SIP stack with Groq as the reasoning engine.
• Test and iterate on agent behavior using LiveKit's built-in test framework with Groq models.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Integrates Groq's fast inference API with LiveKit Agents, enabling real-time LLM responses for voice and conversational agents.

Yes. The plugin has low install friction, active maintenance (released 1 day ago), no known vulnerabilities, and Apache-2.0 licensing. Install it if you are already using LiveKit Agents and want to use Groq as your LLM provider, or if you are evaluating Groq for real-time voice agent workloads. No reason to install it if you are not building with LiveKit Agents.

Install

livekit-plugins-groq on PyPI

pip install livekit-plugins-groq

uv add livekit-plugins-groq

poetry add livekit-plugins-groq

Installing livekit-plugins-groq

Before you install

Low friction install as a pure Python wheel. Actively maintained with a release 1 day old and 13003 repository stars. Requires Python 3.10 or later.

License in practice

Apache-2.0 permissive license allows commercial and private use with minimal restrictions.

Quickstart

pip install livekit-plugins-groq

from livekit.plugins import groq
from livekit.agents import Agent, AgentSession

session = AgentSession(
    llm=groq.LLM(),
)
agent = Agent(instructions="You are a helpful assistant.")
await session.start(agent=agent, room=ctx.room)

Requires GROQ_API_KEY environment variable and valid Groq API credentials; Python 3.10 or later required.

Verify before relying

• Whether Groq API credentials or account setup is required beyond standard environment variables
• Specific latency or throughput characteristics compared to other LLM providers in the LiveKit ecosystem
• Whether this plugin works with all LiveKit Agents features or has known limitations
• Which specific Groq models are supported by this plugin version

Package facts

Evidence: livekit_plugins_groq-1.6.10-py3-none-any.whl

Keywords: ai, audio, groq, livekit, realtime, video, voice

Tags

More Artificial Intelligence packages

Further reading