{"enrichment":{"faq":[{"a":"Tavily Crawl downloads website content across multiple pages and saves it as markdown files for agent workflows, knowledge base backup, or offline study. Configure crawl depth, path filters, and semantic instructions to target specific sections. Supports both full-page archival and context-optimized chunking for LLM integration.","q":"How to use Tavily Crawl for web crawling tasks?"},{"a":"Yes, Tavily Crawl integrates directly into AI agent workflows for automated web search and data retrieval. The skill downloads multi-page website content and converts it to markdown format, enabling agents to access, process, and store web data for knowledge bases, offline archives, or real-time information gathering.","q":"Can Tavily Crawl integrate into an AI agent for web search?"},{"a":"Tavily Crawl offers configurable crawl depth to control how many pages are downloaded, path filters to target specific URL patterns, and semantic instructions to extract particular sections or content types. These settings let you optimize crawling scope and focus results on relevant information for your use case.","q":"What configuration options does Tavily Crawl provide?"},{"a":"Tavily Crawl supports context-optimized chunking specifically designed for LLM integration. Downloaded content is converted to markdown and can be chunked to fit model context windows, making it ideal for feeding web data into language models within agent-based automation pipelines.","q":"How does Tavily Crawl work with LLM agents?"},{"a":"Tavily Crawl saves downloaded website content as markdown files, preserving structure and readability. This format is compatible with agent workflows, knowledge management systems, and offline storage, while the chunking capability enables seamless integration with language models and semantic search systems.","q":"What output formats does Tavily web crawler tool provide?"}],"shadow_tags":["web-scraping-tool","agent-integration","real-time-data-retrieval","search-automation","content-extraction"],"summary_rewrite":"Tavily Crawl downloads website content across multiple pages and saves it as markdown files for agent workflows, knowledge base backup, or offline study. Configure crawl depth, path filters, and semantic instructions to target specific sections. Supports both full-page archival and context-optimized chunking for LLM integration."},"gist":{"api_url":"https://skillfed.io/api/skills/family3253/skill/tavily-crawl.json","as_of":"2026-04-16","description":"Tavily Crawl lets you extract and save website content across multiple pages as markdown files for AI agents. npx skillfed install family3253/skill/tavily-crawl","install":{"manual":["git clone https://github.com/family3253/skill","cp -r skill ~/.claude/skills/tavily-crawl"],"primary":"npx skillfed install family3253/skill/tavily-crawl","version":"b6b9739d"},"kind":"skill","mirror_url":"https://skillfed.io/family3253/skill/tavily-crawl.md","similar":[{"id":"intellectronica/agent-skills/tavily","name":"Tavily","publisher":"intellectronica/agent-skills","url":"https://skillfed.io/intellectronica/agent-skills/tavily"},{"id":"family3253/skill/tavily-extract","name":"Tavily Extract","publisher":"family3253/skill","url":"https://skillfed.io/family3253/skill/tavily-extract"},{"id":"BenedictKing/tavily-web/tavily-web","name":"tavily-web","publisher":"BenedictKing/tavily-web","url":"https://skillfed.io/BenedictKing/tavily-web/tavily-web"},{"id":"andrewyng/context-hub/tavily-best-practices","name":"tavily-best-practices","publisher":"andrewyng/context-hub","url":"https://skillfed.io/andrewyng/context-hub/tavily-best-practices"},{"id":"tavily-ai/skills/tavily-best-practices","name":"tavily-best-practices","publisher":"tavily-ai/skills","url":"https://skillfed.io/tavily-ai/skills/tavily-best-practices"}],"title":"Tavily Crawl by family3253 \u2014 SkillFed","use":{"when":["Yes, Tavily Crawl integrates directly into AI agent workflows for automated web search and data retrieval.","Tavily Crawl offers configurable crawl depth to control how many pages are downloaded, path filters to target specific URL patterns."]},"what":{"lead":"Tavily Crawl lets you extract and save website content across multiple pages as markdown files for AI agents and offline access.","rest":"Tavily Crawl downloads website content across multiple pages and saves it as markdown files for agent workflows, knowledge base backup, or offline study. Configure crawl depth, path filters, and semantic instructions to target specific sections. Supports both full-page archival and context-optimized chunking for LLM integration."}},"id":"family3253/skill/tavily-crawl","install":{"mode":"external","repo":"https://github.com/family3253/skill"},"links":{"html":"https://skillfed.io/family3253/skill/tavily-crawl","md":"https://skillfed.io/family3253/skill/tavily-crawl.md","repo":"https://github.com/family3253/skill"},"meta":{"agents_supported":[],"first_seen":"2026-07-28","forks":1,"language":"Python","last_updated":"2026-04-16","license":null,"name":"Tavily Crawl","publisher":"family3253","stars":0},"relations":{"similar":[{"id":"intellectronica/agent-skills/tavily"},{"id":"family3253/skill/tavily-best-practices"},{"id":"family3253/skill/tavily-extract"},{"id":"BenedictKing/tavily-web/tavily-web"},{"id":"andrewyng/context-hub/tavily-best-practices"},{"id":"tavily-ai/skills/tavily-best-practices"},{"id":"gooseworks-ai/goose-skills/web-search-tavily"},{"id":"family3253/skill/tavily-search"},{"id":"xg-gh-25/SwarmAI/s_tavily-search"},{"id":"malue-ai/dazee-small/tavily"}]},"slug":{"owner":"family3253","repo":"skill","skill":"tavily-crawl"},"version":"b6b9739d"}