seo-firecrawl
seo-firecrawl automates website discovery and analysis by crawling entire domains to extract content, identify all pages, and map structural patterns. It handles JavaScript-rendered sites, supports targeted crawls via path filters, and integrates with other SEO agents for technical audits, content analysis, and schema validation.
seo-firecrawl crawls entire websites to discover all pages, extract content, and map site structure via Firecrawl.
AI-generated summary based on this skill's SKILL.md
Install
AgriciDaniel/claude-seo/seo-firecrawl · repository language: Python
git clone https://github.com/AgriciDaniel/claude-seo
cp -r claude-seo/extensions/firecrawl/skills/seo-firecrawl ~/.claude/skills/seo-firecrawlFrequently asked questions
AI-generated answers based on this skill's SKILL.md and metadata
How does seo-firecrawl crawl entire websites for SEO analysis?
seo-firecrawl automates comprehensive website discovery by crawling entire domains to extract content, identify all pages, and map structural patterns. It handles both static and JavaScript-rendered sites, allowing you to discover all URLs on a domain and perform full-site crawls for technical SEO audits, content inventory, and structural analysis.
Can seo-firecrawl scrape website content with JavaScript rendering?
Yes. seo-firecrawl extracts content from JavaScript-rendered and dynamic pages, enabling you to scrape dynamic content that traditional crawlers miss. This capability supports site-wide content scraping with JavaScript support and helps you access metadata and structured data from pages that rely on client-side rendering.
What does seo-firecrawl do to map site structure and find all pages?
seo-firecrawl maps site structure by systematically crawling your domain and cataloging every discoverable page. It supports targeted crawls via path filters, identifies orphan pages, and generates a complete inventory of URLs. This structural mapping integrates with other SEO agents for technical audits and helps you understand your site's organization.
How can seo-firecrawl help detect broken links on my site?
seo-firecrawl analyzes site crawlability and detects broken links during its full-site crawl process. By mapping all pages and their connections, it identifies links that lead to missing or inaccessible resources, helping you maintain site health and improve user experience through technical SEO improvements.
Is seo-firecrawl suitable for content discovery across entire websites?
Absolutely. seo-firecrawl supports comprehensive content inventory and search within websites for keywords and metadata. It crawls site structure for analysis, extracts all discoverable content, and enables you to catalog and analyze your entire web presence efficiently for SEO purposes.
What license does seo-firecrawl use?
seo-firecrawl is released under the MIT license, making it freely available for commercial and private use with minimal restrictions.
SKILL.md
rendered from the published skill — quoted content, verbatim
Firecrawl Extension for Claude SEO
This skill requires the Firecrawl extension to be installed:
./extensions/firecrawl/install.sh
Check availability: Before using any Firecrawl tool, verify the MCP server
is connected by checking if firecrawl_scrape or any Firecrawl tool
is available. If tools are not available, inform the user the extension is not
installed and provide install instructions.
Quick Reference
| Command | Purpose |
|---|---|
/seo firecrawl crawl <url> |
Full-site crawl with content extraction |
/seo firecrawl map <url> |
Discover site structure (URLs only, fast) |
/seo firecrawl scrape <url> |
Single-page scrape with JS rendering |
| `/seo firecrawl |
(truncated - see the full file via the links below)
Read as markdown · JSON record · Browse the source repository
File tree — 2 files
extensions/firecrawl/skills/seo-firecrawl/LICENSE.txt
extensions/firecrawl/skills/seo-firecrawl/SKILL.md