firecrawl
Firecrawl exposes web search and page scraping through a simple REST API, returning results as clean markdown. Use the `/search` endpoint to find pages by query, then `/scrape` to extract content from any URL or public PDF. Requires an API key stored in your agent's vault.
Firecrawl searches the web by query and scrapes pages into clean markdown via REST API.
AI-generated summary based on this skill's SKILL.md
Decision gist · record as of 2026-07-27
Firecrawl searches the web by query and scrapes pages into clean markdown via REST API. Firecrawl exposes web search and page scraping through a simple REST API, returning results as clean markdown. Use the `/search` endpoint to find pages by query, then `/scrape` to extract content from any URL or public PDF. Requires an API key stored in your agent's vault.
Use it when
- Yes.
- Firecrawl requires an API key, which you should store in your agent's vault for secure access.
Verify before relying
Read SKILL.md below before installing (2 files). Open directory: indexed for reading, not audited.
Install
Prism-Shadow/penguin-harness/firecrawl · repository language: TypeScript
Open directory. Skills are indexed for reading, not audited. Review a skill's body before installing it.
Frequently asked questions
AI-generated answers based on this skill's SKILL.md and metadata
How does firecrawl search the web and get markdown?
Firecrawl provides a REST API with a `/search` endpoint that queries the web and returns results as clean markdown. You supply a search query and receive structured markdown-formatted results ready for agent processing. The service handles web discovery and returns page metadata alongside content.
Can firecrawl scrape website content into markdown format?
Yes. Firecrawl's `/scrape` endpoint extracts content from any URL or public PDF and converts it to structured markdown. Simply provide the URL or PDF link and firecrawl returns agent-ready markdown content without manual parsing or formatting work.
What do I need to use the firecrawl API?
Firecrawl requires an API key, which you should store in your agent's vault for secure access. Once configured, you can call the `/search` and `/scrape` endpoints via REST to search the web, scrape pages, and extract document content as markdown.
How does firecrawl extract current web information for workflows?
Firecrawl integrates live web access into agent tasks and workflows through its REST API. Use `/search` to find fresh pages by query and `/scrape` to pull current content from URLs or PDFs. Results arrive as clean markdown, enabling agents to incorporate real-time web data into decision-making and automation.
Can firecrawl scrape multiple pages or PDFs?
Firecrawl's `/scrape` endpoint handles individual URLs and public PDFs. For multiple pages, you can make sequential API calls to scrape each URL or PDF separately, with each request returning clean markdown content ready for further processing or aggregation by your agent.
Is firecrawl open source and what license does it use?
Firecrawl is distributed under the Apache-2.0 license, making it open source. This permissive license allows you to use, modify, and distribute firecrawl in your projects while maintaining compliance with Apache-2.0 terms.
SKILL.md
Rendered from the published skill. Quoted content, verbatim.
Firecrawl
Firecrawl turns the live web into agent-ready markdown over a plain REST API (https://api.firecrawl.dev/v2, Authorization: Bearer $FIRECRAWL_API_KEY). Two calls cover most web work: /search to discover pages by query, /scrape to extract clean content from a URL you already have. Use it whenever a task needs current web information or the content of a specific page.
Before you start
If the user's message only invokes this skill (e.g. "use firecrawl skill") without a concrete task, ask what they want to search or scrape. When the task is concrete, check the credential first:
[ -n "$FIRECRAWL_API_KEY" ] && echo ok || echo missing
If missing (also visible in your Vault Keys section), ask the user to add FIRECRAWL_API_KEY to this agent's key vault — gear icon on the
(truncated - see the full file via the links below)
File tree — 2 files
packages/skills/skills/firecrawl/SKILL.md
packages/skills/skills/firecrawl/icon.svg
Let your AI agent find skills like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 56,283 agent skills by what they can do, searchable in plain language.
wish › “Search the web by query and retrieve clean markdown results”
Give your agent the search over MCP, or paste the wish link into any chat. No install? Search from any chat →
Related skills
Firecrawl Search performs web searches and returns results with optional full-page content extraction in markdown format. Use it to find pages, answer questions, discover sources, or research topics—going beyond snippet-only results. Supports filtering by source type, time range, location, and category.
Firecrawl Web Scraper turns website content into structured markdown optimized for AI models. It handles dynamic JavaScript rendering, bypasses bot protection, and supports single-page scraping, full-site crawling, URL discovery, and schema-based data extraction.
Search Tips provides practical guidance for conducting thorough web research using Exa's semantic search engine, Firecrawl CLI for content extraction, and Reddit MCP tools. It covers the research cycle of searching for sources and fetching their content, query reformulation techniques for better results, domain filtering, and content-type-specific strategies. The skill includes troubleshooting for common scraping issues and operational patterns for efficient multi-source investigation.
Firecrawl is a command-line tool for extracting web content at scale, supporting search, single-page scraping, site mapping, bulk crawling, and browser automation for interactive pages. It returns clean markdown formatted for LLM context windows and handles everything from static pages to JavaScript-rendered content and pagination-gated data.
Firecrawl Scrape converts web pages into clean, LLM-ready markdown—whether static or dynamically rendered with JavaScript. It handles single URLs or batch scraping with concurrent processing, and offers filtering options like main-content-only extraction and PII redaction.
Firecrawl Crawl bulk-extracts content from websites by following links across multiple pages with configurable depth and scope controls. Use it when you need to gather data from entire documentation sections, site hierarchies, or collections of related pages in a single operation.
More skills firecrawl-scraper (MIT)