Packages
yt-dlp downloads audio and video from thousands of sites via a command-line interface, supporting format selection, metadata modification, and post-processing.
Install it if you need to download video or audio from the web.
MoviePy is a Python library for video editing that reads, processes, and writes video and audio files by converting them to numpy arrays for frame-level manipulation and effect application.
Generate access tokens and call LiveKit server APIs (room management, egress, ingress, SIP, agent dispatch, connectors) from Python backends using async/await.
Install it if you are building a backend that needs to generate tokens, manage rooms, or integrate with LiveKit's services.
pytube downloads YouTube videos and playlists to local files via Python API or command-line interface, with support for multiple stream formats and quality levels.
A framework for building realtime multimodal and voice AI agents that connect to LiveKit rooms and handle audio/video interactions with language models.
ffmpy is a Python wrapper around FFmpeg that lets you build and execute FFmpeg command lines programmatically without writing shell commands directly.
Python SDK for building real-time video, audio, and data applications by connecting to LiveKit servers as a participant or managing rooms via server APIs.
Provides Silero voice activity detection integration for the LiveKit Agents framework to detect when users are speaking in real-time voice agent applications.
Integrates OpenAI's Realtime, Responses, LLM, TTS, and STT APIs into LiveKit Agents, plus support for OpenAI-compatible providers like Azure OpenAI, Cerebras, Fireworks, Perplexity, and others.
Install it if you're already using LiveKit Agents and want OpenAI integration.
Provides BlingFire tokenization bindings for the LiveKit Agents framework, enabling fast text segmentation and linguistic analysis within voice agent applications.
Integrates Deepgram's voice AI services (speech-to-text and text-to-speech) into LiveKit Agents for real-time audio processing in agent applications.
Install it if you are building LiveKit Agents that need Deepgram's speech-to-text or text-to-speech services.
Detects end-of-turn in voice conversations for LiveKit Agents using a language model trained for this task, replacing simpler voice activity detection with more accurate interruption prevention.
Cloudinary Python SDK provides image and video upload, transformation, optimization, and delivery through Cloudinary's cloud platform, with built-in Django integration and secure URL generation.
Install it if you're using Cloudinary or considering a managed media platform.
Integrates ElevenLabs text-to-speech into the LiveKit Agents framework for building realtime voice agents that can speak with ElevenLabs' voices.
Enables Python bots to join Telegram voice chats, make and receive private calls, and broadcast audio using WebRTC via the tgcalls C++ binding and MTProto protocol.
Supervision provides utilities for loading, annotating, and processing computer vision datasets and model outputs—detection, segmentation, and classification results from any model framework.
Install it if you work with detection, segmentation, or classification models and want to avoid reinventing dataset utilities.
Integrates Cartesia's voice AI services (speech-to-text and text-to-speech) into LiveKit Agents for real-time voice applications.
scikit-video reads, writes, and analyzes video files using FFmpeg, providing Python functions for frame extraction and video quality metrics including SSIM, PSNR, NIQE, and BRISQUE.
The main gotcha is the hard requirement for FFmpeg on the system PATH and Python >= 3.10; verify your environment supports both before committing.
Pipecat is a Python framework for building real-time voice and multimodal conversational AI agents, with support for orchestrating audio, video, AI services, and multi-agent coordination over shared buses or distributed systems.
Integrates Google Cloud AI services (Gemini, Speech-to-Text, Text-to-Speech) with LiveKit Agents for building real-time conversational applications.
Mediapy reads, writes, and displays images and videos directly in IPython and Jupyter notebooks, returning them as numpy arrays for further processing.
Detects scene cuts and shot changes in videos, then splits them into separate clips using command-line or Python API.
Server-side SDK for generating OpenTok sessions, tokens, and managing session archives via the Tokbox/OpenTok platform API.
However, if you are starting a new project, verify whether you should use the newer Vonage Server SDK for Python instead, which supports the unified Vonage Video API…
Integrates Anthropic's Claude models into LiveKit's agent framework, enabling voice agents to use Claude for natural language understanding and generation in real-time conversations.
Parses and builds MP4 box structures from binary data using the construct library, enabling programmatic inspection and manipulation of MP4 file metadata.
Install only if you are comfortable with no active bug fixes or feature development; for production use, verify that its scope matches your MP4 variant and box types.
Integrates AssemblyAI speech-to-text into the LiveKit Agents framework for building real-time voice agents.
Parse, modify, and compose SRT subtitle files with support for broken or malformed files and Asian-style formats.
pysrt parses, edits, and writes SubRip (.srt) subtitle files, offering both a Python library API and a command-line tool for shifting, splitting, and rescaling subtitles.
Integrates Amazon AWS AI services (Bedrock, Polly, Transcribe, Nova) into LiveKit Agents for speech-to-speech, text-to-speech, speech-to-text, and LLM capabilities.
Install it if you are building LiveKit voice agents and need AWS AI services (Bedrock, Transcribe, Polly, Nova).
Downloads YouTube videos, playlists, and channels in multiple formats and resolutions, with support for subtitles, metadata extraction, and asynchronous operations.
Integrates Azure AI services, particularly Azure Speech, into LiveKit Agents for real-time voice and audio processing in agent applications.
Reads, writes, and processes video files using FFmpeg as its backend, providing video I/O and quality metrics (NIQE, BRISQUE, SSIM, PSNR) built on numpy and scipy.
A Python SDK for building video and audio calling into desktop and server applications, with support for joining meetings, managing participants, and sending/receiving media streams.
Install only if your application targets Python 3.8+ and your deployment environment meets the glibc requirement.
Kivy is a Python framework for building graphical user interfaces that run on desktop, mobile, and embedded platforms from a single codebase, with native support for multitouch input and cross-platform deployment.
Not recommended if you need native platform look-and-feel or tight integration with platform-specific APIs—consider platform-specific frameworks for those cases.
Integrates xAI's Grok LLM with LiveKit's Agent Framework to enable voice agents that can understand and respond in real-time conversations.
pysubs2 loads, edits, and saves subtitle files in multiple formats including SubStation Alpha, SubRip, MicroDVD, MPL2, TMP, WebVTT, TTML, SAMI, and OpenAI Whisper captions, with a CLI tool for batch conversion and retiming.
Install it if you need to programmatically work with subtitles or build subtitle conversion and retiming tools.
Command-line tool to download videos from YouTube and other video platforms, with support for playlists, format selection, and extensive configuration options.
However, install it only if you accept that extractors may be outdated—the last release was in 2021, and YouTube's anti-scraping measures evolve frequently.
Manim is an animation engine that creates precise, programmatic animations for explanatory math videos, rendering geometric shapes, transformations, and mathematical concepts as video output.
Streamlink extracts video streams from various online services and pipes them into a video player or file, bypassing resource-heavy websites to access streamed content directly.
Python ctypes-based bindings to libvlc that let you control VLC media playback and access its API from Python code.