{"categories":[{"label":"Software Development","url":"https://skillfed.io/packages/category/software-development/2"},{"label":"Libraries","url":"https://skillfed.io/packages/category/software-development-libraries/2"},{"label":"Scientific/Engineering","url":"https://skillfed.io/packages/category/scientific-engineering"},{"label":"Python Modules","url":"https://skillfed.io/packages/category/software-development-libraries-python-modules/4"},{"label":"Internet","url":"https://skillfed.io/packages/category/internet"},{"label":"WWW/HTTP","url":"https://skillfed.io/packages/category/internet-www-http"},{"label":"Text Processing","url":"https://skillfed.io/packages/category/text-processing"},{"label":"Bio-Informatics","url":"https://skillfed.io/packages/category/scientific-engineering-bio-informatics"},{"label":"Medical Science Apps.","url":"https://skillfed.io/packages/category/scientific-engineering-medical-science-apps"},{"label":"Indexing/Search","url":"https://skillfed.io/packages/category/internet-www-http-indexing-search"},{"label":"Indexing","url":"https://skillfed.io/packages/category/text-processing-indexing"}],"enrichment":{"capability":"Client library for the Firecrawl API that scrapes, crawls, and searches the web, returning clean Markdown or structured data; also indexes research papers from PubMed, bioRxiv, medRxiv, and arXiv.","skillfed_tags":["web-scraping","research-papers","ai-agents"],"use_cases":["Scrape product pages to extract title, price, availability, and variants deterministically.","Crawl a website up to a specified depth and format limit to build a searchable knowledge base.","Search academic literature by querying abstracts from biomedical and physics preprint repositories.","Extract Markdown from web pages for ingestion into RAG (retrieval-augmented generation) pipelines.","Map a website's URL structure with optional sitemap and subdomain inclusion for discovery."],"what_it_does":"Firecrawl-py is a Python client for the Firecrawl web scraping and search service. It provides methods to scrape individual URLs, crawl entire websites, search the web, and query a research paper index covering PubMed, bioRxiv, medRxiv, and arXiv abstracts. The library returns content in multiple formats\u2014Markdown, HTML, video, product data, menu data\u2014and supports both synchronous and asynchronous operations. It depends on requests, httpx, websockets, aiohttp, pydantic, python-dotenv, and nest-asyncio for HTTP, async, and configuration handling.\n\nThe package is designed for AI agents and applications that need to extract structured or semi-structured data from web pages or search academic literature. It handles pagination automatically, supports interactive browsing actions, and provides specialized extraction for product pages and restaurant menus. The research paper search methods return raw JSON with camelCase keys, distinct from the rest of the SDK's snake_case convention.","worth_installing":"Yes. The package is actively maintained, has no known vulnerabilities, uses a permissive MIT license, and installs with low friction. It is well-suited for developers building AI agents or applications that need web scraping, crawling, or research paper search. The primary constraint is the requirement for a Firecrawl API key and service account."},"id":"firecrawl-py","links":{"html":"https://skillfed.io/packages/firecrawl-py","md":"https://skillfed.io/packages/firecrawl-py.md","pypi":"https://pypi.org/project/firecrawl-py/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-12","license_spdx":null,"license_treatment":"permissive","name":"firecrawl-py","python_support":"supports_current","summary":"Python SDK for the Firecrawl API: web scraping, crawling, web search, and scientific literature search over a research paper index of PubMed, bioRxiv, medRxiv and arXiv abstracts"},"popularity":{"monthly_downloads":7323775,"position":1752,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"4.35.0"}