livekit-plugins-groq
Groq inference plugin for LiveKit Agents
Decision gist · record as of 2026-08-14
Yes. The plugin has low install friction, active maintenance (released 1 day ago), no known vulnerabilities, and Apache-2.0 licensing. Install it if you are already using LiveKit Agents and want to use Groq as your LLM provider, or if you are evaluating Groq for real-time voice agent workloads. No reason to install it if you are not building with LiveKit Agents.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires GROQ_API_KEY environment variable and valid Groq API credentials; Python 3.10 or later required.
- Low friction install as a pure Python wheel.
- Actively maintained with a release 1 day old and 13003 repository stars.
License · maintenance · safety
Apache-2.0 (permissive) — Apache-2.0 permissive license allows commercial and private use with minimal restrictions.
last release 2026-08-13 (1 days) · last repo commit 2026-08-14 · 13,003 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 443,509 downloads/mo, #6,628 on PyPI
Alternatives
Verify before relying
pip install livekit-plugins-groq
from livekit.plugins import groq
from livekit.agents import Agent, AgentSession
session = AgentSession(
llm=groq.LLM(),
)
agent = Agent(instructions="You are a helpful assistant.")
await session.start(agent=agent, room=ctx.room)- Whether Groq API credentials or account setup is required beyond standard environment variables
- Specific latency or throughput characteristics compared to other LLM providers in the LiveKit ecosystem
- Whether this plugin works with all LiveKit Agents features or has known limitations
- Which specific Groq models are supported by this plugin version
What it is and what it does
This package is a plugin that connects Groq's inference API to the LiveKit Agents framework, allowing you to build real-time voice and conversational agents powered by Groq's LLM models. It acts as a bridge between LiveKit's agent orchestration layer and Groq's fast inference service, letting you swap in Groq as your LLM provider alongside other STT, TTS, and realtime API choices.
The plugin integrates into LiveKit's existing agent architecture, so you use it the same way you'd use any other LLM provider in the framework—by passing a Groq LLM instance to your AgentSession. It inherits all of LiveKit Agents' features: multi-agent handoff, function tools, semantic turn detection, and test framework support. The plugin is maintained as part of the main LiveKit Agents repository and released frequently.
Use it for
- Build a voice assistant using Groq inference to reduce latency in real-time conversations.
- Create a multi-modal agent combining Groq LLM with LiveKit's STT and TTS for end-to-end voice interactions.
- Replace another LLM provider with Groq in an existing LiveKit agent without changing core logic.
- Deploy a telephony-integrated voice agent using LiveKit's SIP stack with Groq as the reasoning engine.
- Test and iterate on agent behavior using LiveKit's built-in test framework with Groq models.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes.
The plugin has low install friction, active maintenance (released 1 day ago), no known vulnerabilities, and Apache-2.0 licensing. Install it if you are already using LiveKit Agents and want to use Groq as your LLM provider, or if you are evaluating Groq for real-time voice agent workloads. No reason to install it if you are not building with LiveKit Agents.
Install
livekit-plugins-groq on PyPI
Before you install
Low friction install as a pure Python wheel. Actively maintained with a release 1 day old and 13003 repository stars. Requires Python 3.10 or later.
Requires GROQ_API_KEY environment variable and valid Groq API credentials; Python 3.10 or later required.
License in practice
Apache-2.0 permissive license allows commercial and private use with minimal restrictions.
Quickstart
pip install livekit-plugins-groq
from livekit.plugins import groq
from livekit.agents import Agent, AgentSession
session = AgentSession(
llm=groq.LLM(),
)
agent = Agent(instructions="You are a helpful assistant.")
await session.start(agent=agent, room=ctx.room)Verify before relying
- Whether Groq API credentials or account setup is required beyond standard environment variables
- Specific latency or throughput characteristics compared to other LLM providers in the LiveKit ecosystem
- Whether this plugin works with all LiveKit Agents features or has known limitations
- Which specific Groq models are supported by this plugin version
Package facts
| License | Apache-2.0 permissive |
| Python support | Supports the current Python release >=3.10.0 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 3 packagesaiohttplivekitlivekit-agents |
| Maintenance | Actively maintained 1 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 443,509 / month, #6,628 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Intended Audience :: DevelopersProgramming Language :: Python :: 3Programming Language :: Python :: 3 :: OnlyProgramming Language :: Python :: 3.11Programming Language :: Python :: 3.12Topic :: Multimedia :: Sound/AudioTopic :: Scientific/Engineering :: Artificial Intelligence |
Evidence: livekit_plugins_groq-1.6.10-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “groq llm plugin livekit agents”
- livekit-plugins-groqIntegrates Groq's fast inference API with LiveKit Agents, enabling…
- livekit-plugins-sarvamIntegrates Sarvam.ai's Indian-language voice AI services…
- livekit-plugins-anthropicIntegrates Anthropic's Claude models into LiveKit's agent framework,…
Give your agent the search over MCP, or paste the wish link into any chat.
More Artificial Intelligence packages
LiteLLM provides a unified Python interface to call 100+ LLM providers (OpenAI, Anthropic, Gemini, Bedrock, Azure, and others) using OpenAI-compatible API format, available as both a Python SDK and a self-hosted AI Gateway proxy server.
Install it if you need to work with multiple LLM providers or want to centralize LLM routing in your organization.
Client library and CLI tool for downloading, uploading, and managing models, datasets, and repositories on the Hugging Face Hub platform.
Install it if you work with Hugging Face Hub models or datasets.
LangChain provides a framework for building agents and LLM-powered applications by composing language models, tools, and memory through a unified API that abstracts over multiple model providers.
hf-xet provides chunk-based deduplication and efficient file transfer for the Hugging Face Hub, enabling faster uploads and downloads of large files with local disk caching.
Tokenizers converts raw text into token sequences for NLP models, with support for training custom vocabularies and using pre-built tokenizers (BPE, WordPiece) optimized for speed via Rust.
Transformers provides a unified framework for loading, fine-tuning, and running state-of-the-art pretrained models across text, vision, audio, video, and multimodal tasks using PyTorch, JAX, or TensorFlow.
Install it if you need to run or train any transformer-based model for NLP, vision, audio, or multimodal tasks.
See also livekit-plugins-assemblyai · livekit-plugins-rime · livekit-plugins-xai · livekit-plugins-anthropic · livekit-plugins-elevenlabs · livekit-plugins-telnyx · livekit-plugins-anam · livekit-blingfire · livekit-plugins-silero · dify-plugin