seo-firecrawl
seo-firecrawl automates website discovery and analysis by crawling entire domains to extract content, identify all pages, and map structural patterns. It handles JavaScript-rendered sites, supports targeted crawls via path filters, and integrates with other SEO agents for technical audits, content analysis, and schema validation.
seo-firecrawl crawls entire websites to discover all pages, extract content, and map site structure via Firecrawl.
AI-generated summary based on this skill's SKILL.md
Decision gist · record as of 2026-07-27
seo-firecrawl crawls entire websites to discover all pages, extract content, and map site structure via Firecrawl. seo-firecrawl automates website discovery and analysis by crawling entire domains to extract content, identify all pages, and map structural patterns. It handles JavaScript-rendered sites, supports targeted crawls via path filters, and integrates with other SEO agents for technical audits, content analysis, and schema validation.
Use it when
- Yes.
- seo-firecrawl maps site structure by systematically crawling your domain and cataloging every discoverable page.
Verify before relying
Read SKILL.md below before installing (2 files). Open directory: indexed for reading, not audited.
Install
AgriciDaniel/claude-seo/seo-firecrawl · repository language: Python
Open directory. Skills are indexed for reading, not audited. Review a skill's body before installing it.
Frequently asked questions
AI-generated answers based on this skill's SKILL.md and metadata
How does seo-firecrawl crawl entire websites for SEO analysis?
seo-firecrawl automates comprehensive website discovery by crawling entire domains to extract content, identify all pages, and map structural patterns. It handles both static and JavaScript-rendered sites, allowing you to discover all URLs on a domain and perform full-site crawls for technical SEO audits, content inventory, and structural analysis.
Can seo-firecrawl scrape website content with JavaScript rendering?
Yes. seo-firecrawl extracts content from JavaScript-rendered and dynamic pages, enabling you to scrape dynamic content that traditional crawlers miss. This capability supports site-wide content scraping with JavaScript support and helps you access metadata and structured data from pages that rely on client-side rendering.
What does seo-firecrawl do to map site structure and find all pages?
seo-firecrawl maps site structure by systematically crawling your domain and cataloging every discoverable page. It supports targeted crawls via path filters, identifies orphan pages, and generates a complete inventory of URLs. This structural mapping integrates with other SEO agents for technical audits and helps you understand your site's organization.
How can seo-firecrawl help detect broken links on my site?
seo-firecrawl analyzes site crawlability and detects broken links during its full-site crawl process. By mapping all pages and their connections, it identifies links that lead to missing or inaccessible resources, helping you maintain site health and improve user experience through technical SEO improvements.
Is seo-firecrawl suitable for content discovery across entire websites?
Absolutely. seo-firecrawl supports comprehensive content inventory and search within websites for keywords and metadata. It crawls site structure for analysis, extracts all discoverable content, and enables you to catalog and analyze your entire web presence efficiently for SEO purposes.
What license does seo-firecrawl use?
seo-firecrawl is released under the MIT license, making it freely available for commercial and private use with minimal restrictions.
SKILL.md
Rendered from the published skill. Quoted content, verbatim.
Firecrawl Extension for Claude SEO
This skill requires the Firecrawl extension to be installed:
./extensions/firecrawl/install.sh
Check availability: Before using any Firecrawl tool, verify the MCP server
is connected by checking if firecrawl_scrape or any Firecrawl tool
is available. If tools are not available, inform the user the extension is not
installed and provide install instructions.
Quick Reference
| Command | Purpose |
|---|---|
/seo firecrawl crawl <url> |
Full-site crawl with content extraction |
/seo firecrawl map <url> |
Discover site structure (URLs only, fast) |
/seo firecrawl scrape <url> |
Single-page scrape with JS rendering |
| `/seo firecrawl |
(truncated - see the full file via the links below)
File tree — 2 files
extensions/firecrawl/skills/seo-firecrawl/LICENSE.txt
extensions/firecrawl/skills/seo-firecrawl/SKILL.md
Let your AI agent find skills like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 56,283 agent skills by what they can do, searchable in plain language.
wish › “Crawl and map entire website structure to discover all pages”
Give your agent the search over MCP, or paste the wish link into any chat. No install? Search from any chat →
Related skills
Seo Firecrawl enables full-site crawling, URL discovery, and single-page scraping with JavaScript rendering support. Use it to extract all pages and links from a domain, detect broken links, analyze site structure, or audit content at scale—ideal for comprehensive SEO reviews and competitor research.
Extract individual web pages into clean, structured markdown using Firecrawl's API. The skill manages JavaScript rendering, anti-bot defenses, and dynamic content automatically, supporting multiple output formats including markdown, HTML, summaries, and screenshots. Configure proxy modes and timeouts to handle everything from standard sites to protected news content.
This skill leverages the Firecrawl API to pull content from web pages in multiple formats—markdown, HTML, JSON, screenshots, and PDFs. It supports single-page scraping, full-site crawling with depth and path controls, batch processing of multiple URLs, and browser automation through actions like clicks and scrolls. Use it whenever you need to gather web data, extract structured information with custom schemas, or interact with dynamic pages.
Firecrawl Web Scraper turns website content into structured markdown optimized for AI models. It handles dynamic JavaScript rendering, bypasses bot protection, and supports single-page scraping, full-site crawling, URL discovery, and schema-based data extraction.
This skill helps you evaluate your website's search engine performance and identify concrete improvements to increase organic traffic. Get actionable insights into ranking factors, competitive positioning, and technical SEO elements that impact visibility across major search engines.
Claude SEO is an open-source analysis tool that integrates directly into Claude Code, enabling you to run detailed audits across multiple SEO dimensions simultaneously. The skill deploys 25 specialized checks and 18 expert agents to evaluate technical foundations, content strength, structured data implementation, search visibility, local presence, and ecommerce factors all at once.
More skills Firecrawl (unlicensed) · Firecrawl Map (unlicensed)