--- id: livekit-plugins-groq version: "1.6.10" license: Apache-2.0 license_treatment: permissive maintenance: active --- # livekit-plugins-groq — Groq inference plugin for LiveKit Agents License: permissive · Maintenance: active · Downloads: 443.5K/mo ## What it is and what it does This package is a plugin that connects Groq's inference API to the LiveKit Agents framework, allowing you to build real-time voice and conversational agents powered by Groq's LLM models. It acts as a bridge between LiveKit's agent orchestration layer and Groq's fast inference service, letting you swap in Groq as your LLM provider alongside other STT, TTS, and realtime API choices. The plugin integrates into LiveKit's existing agent architecture, so you use it the same way you'd use any other LLM provider in the framework—by passing a Groq LLM instance to your AgentSession. It inherits all of LiveKit Agents' features: multi-agent handoff, function tools, semantic turn detection, and test framework support. The plugin is maintained as part of the main LiveKit Agents repository and released frequently. Use it for: - Build a voice assistant using Groq inference to reduce latency in real-time conversations. - Create a multi-modal agent combining Groq LLM with LiveKit's STT and TTS for end-to-end voice interactions. - Replace another LLM provider with Groq in an existing LiveKit agent without changing core logic. - Deploy a telephony-integrated voice agent using LiveKit's SIP stack with Groq as the reasoning engine. - Test and iterate on agent behavior using LiveKit's built-in test framework with Groq models. ## Worth the install? AI-flagged interpretation of the facts above — verify before relying. Integrates Groq's fast inference API with LiveKit Agents, enabling real-time LLM responses for voice and conversational agents. Yes. The plugin has low install friction, active maintenance (released 1 day ago), no known vulnerabilities, and Apache-2.0 licensing. Install it if you are already using LiveKit Agents and want to use Groq as your LLM provider, or if you are evaluating Groq for real-time voice agent workloads. No reason to install it if you are not building with LiveKit Agents. ## Install pip install livekit-plugins-groq uv add livekit-plugins-groq poetry add livekit-plugins-groq ## Installing livekit-plugins-groq Before you install: Low friction install as a pure Python wheel. Actively maintained with a release 1 day old and 13003 repository stars. Requires Python 3.10 or later. License in practice: Apache-2.0 permissive license allows commercial and private use with minimal restrictions. Quickstart: pip install livekit-plugins-groq from livekit.plugins import groq from livekit.agents import Agent, AgentSession session = AgentSession( llm=groq.LLM(), ) agent = Agent(instructions="You are a helpful assistant.") await session.start(agent=agent, room=ctx.room) Requires GROQ_API_KEY environment variable and valid Groq API credentials; Python 3.10 or later required. Verify before relying: - Whether Groq API credentials or account setup is required beyond standard environment variables - Specific latency or throughput characteristics compared to other LLM providers in the LiveKit ecosystem - Whether this plugin works with all LiveKit Agents features or has known limitations - Which specific Groq models are supported by this plugin version ## Package facts - License: Apache-2.0 (permissive) - Python support: supports_current - Install friction: low - Maintenance: active - Downloads: 443.5K/month (top 15,000 on PyPI) - Known vulnerabilities: none known ## Tags groq llm plugin livekit agents, real-time inference groq, voice agent groq integration, livekit groq llm, fast inference agents, groq realtime api, livekit-plugin, groq-integration, voice-agents [View on SkillFed](https://skillfed.io/packages/livekit-plugins-groq) · [View on PyPI](https://pypi.org/project/livekit-plugins-groq/)