{"categories":[{"label":"Python Modules","url":"https://skillfed.io/packages/category/software-development-libraries-python-modules/13"}],"enrichment":{"capability":"Python SDK wrapper for ScrapingBee's web scraping API, providing methods to scrape HTML, search results, product data, and interact with AI endpoints via a managed proxy and headless browser service.","skillfed_tags":["web-scraping","api-client","data-extraction"],"use_cases":["Scrape product listings and pricing from Amazon, Walmart, or other e-commerce sites for price monitoring or market research.","Extract search results from Google or YouTube in bulk for SEO analysis, competitor research, or content aggregation.","Retrieve HTML content from JavaScript-heavy websites that require a headless browser to render.","Monitor web pages for changes or updates by periodically fetching and comparing HTML snapshots.","Integrate web data collection into a data pipeline where you need reliable, proxy-rotated requests without managing infrastructure."],"what_it_does":"ScrapingBee is a Python client for a managed web scraping service that abstracts away the complexity of headless browsers, proxy rotation, and anti-bot detection. Instead of managing your own browser automation or proxy infrastructure, you instantiate a client with an API key and call methods like html_api(), google_search(), amazon_product(), or youtube_metadata() to fetch structured or raw data from target sites. The service handles rendering JavaScript, rotating proxies, and retrying failed requests on your behalf; you pay per request in API credits.\n\nThe SDK wraps requests and typing_extensions to provide a simple interface to ScrapingBee's endpoints. It supports both GET and POST requests, optional JavaScript rendering, screenshots, and an Auto-Mode feature that tries cheaper configurations first and charges only for the one that succeeds. Use it when you need reliable scraping without maintaining your own infrastructure, or when target sites require sophisticated anti-bot evasion that would be expensive to build yourself.","worth_installing":"Yes, if you need web scraping and can absorb the per-request API cost. The SDK is actively maintained, has low install friction, and eliminates the operational burden of managing browsers and proxies. No, if you prefer open-source scraping tools (requests, BeautifulSoup, Scrapy) or cannot justify the recurring API charges. Yes-with-conditions if you're already using Scrapy\u2014the package integrates via middleware, but you'll still incur per-request costs."},"id":"scrapingbee","links":{"html":"https://skillfed.io/packages/scrapingbee","md":"https://skillfed.io/packages/scrapingbee.md","pypi":"https://pypi.org/project/scrapingbee/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-06","license_spdx":null,"license_treatment":"permissive","name":"scrapingbee","python_support":"supports_current","summary":"ScrapingBee Python SDK"},"popularity":{"monthly_downloads":336929,"position":7454,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"2.1.1"}