claude-real-video-for-agents
Claude Real Video lets AI agents process videos by intelligently extracting scene-aware keyframes and audio transcripts. It uses scene-change detection and deduplication to reduce token usage—a 58-second clip yields 26 meaningful frames instead of 58, packed into contact sheets for efficient LLM consumption.
Claude Real Video for Agents extracts and deduplicates keyframes from videos so AI agents can analyze them.
AI-generated summary based on this skill's SKILL.md
Install
HUANGCHIHHUNGLeo/claude-real-video/claude-real-video-for-agents · repository language: Python
git clone https://github.com/HUANGCHIHHUNGLeo/claude-real-video
cp -r claude-real-video/skills/claude-real-video-for-agents ~/.claude/skills/claude-real-video-for-agentsnpx skillfed install HUANGCHIHHUNGLeo/claude-real-video/claude-real-video-for-agentsFrequently asked questions
AI-generated answers based on this skill's SKILL.md and metadata
How do I make AI agents watch videos with claude-real-video?
Claude Real Video enables agents to process videos by extracting scene-aware keyframes and audio transcripts. The tool uses scene-change detection to identify meaningful moments, then deduplicates frames and packs them into contact sheets. This approach lets agents understand video content without processing every single frame, reducing token usage significantly.
How does claude-real-video extract keyframes from video?
Claude Real Video uses scene-change detection to identify visually distinct moments in your video, then extracts keyframes at those transition points. It automatically deduplicates similar frames so you get only the meaningful ones. For example, a 58-second clip typically yields 26 keyframes instead of 58, capturing scene changes rather than redundant content.
Can I convert video to frames and transcript for multimodal analysis?
Yes. Claude Real Video transcribes audio using Whisper and pairs the transcript with extracted keyframes. This multimodal pairing lets agents understand both visual and audio content together, enabling richer analysis of video material for your AI workflows.
Does claude-real-video process videos locally without uploading?
Claude Real Video processes local or URL-based videos offline without uploading to external services. You maintain full control over your video data while the tool handles keyframe extraction, deduplication, and transcription on your machine.
What is crv installation and how do I set it up?
Claude Real Video can be installed as an agent skill (crv) to enable video analysis workflows directly in your agent pipelines. Installation integrates the tool into your agent environment, allowing automated video processing tasks like frame extraction, transcription, and contact sheet generation as part of your agent's capabilities.
How does claude-real-video reduce token usage for LLM consumption?
Claude Real Video packs deduplicated keyframes into contact sheets—grid layouts that combine multiple frames into single images. This dramatically reduces the number of tokens needed compared to processing individual frames. Scene-aware deduplication ensures you send only meaningful visual content to your LLM, maximizing efficiency.
SKILL.md
rendered from the published skill — quoted content, verbatim
claude-real-video for AI agents
What is crv?
crv (claude-real-video) is a CLI tool that extracts meaningful frames and transcripts from videos so AI agents can "see" and "read" them. It uses scene-change detection (not fixed-interval sampling), sliding-window deduplication, and optional Whisper transcription.
Key advantage: Same 58-second clip at fixed 1fps = 58 frames. crv keeps the 26 that actually differ, and --grid packs them into 3 contact sheets. Fewer tokens, nothing missed.
Installation
Prerequisites
- Python 3.10+
- ffmpeg / ffprobe on PATH
# macOS
brew install ffmpeg
# Linux
sudo apt install ffmpeg
# Windows
winget install Gyan.FFmpeg
Install crv
```bash
Recommended: with audio transcription support
pip install "claude-real-video[whisper]"
Core only (frames + dedup)
pip install
(truncated - see the full file via the links below)
Read as markdown · JSON record · Browse the source repository
File tree — 1 file
skills/claude-real-video-for-agents/SKILL.md