scrapingbee
ScrapingBee Python SDK
Decision gist · record as of 2026-08-14
Yes, if you need web scraping and can absorb the per-request API cost. The SDK is actively maintained, has low install friction, and eliminates the operational burden of managing browsers and proxies. No, if you prefer open-source scraping tools (requests, BeautifulSoup, Scrapy) or cannot justify the recurring API charges. Yes-with-conditions if you're already using Scrapy—the package integrates via middleware, but you'll still incur per-request costs.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires a ScrapingBee API key (obtained by signing up at scrapingbee.com); API calls consume credits from your account.
- Low friction: pure Python wheel with only two lightweight runtime dependencies (requests and typing_extensions).
- Repository is actively maintained with a recent commit on 2026-08-14 and no archived status.
License · maintenance · safety
MIT (permissive) — MIT license permits commercial and private use with minimal restrictions, making it suitable for most projects without legal friction.
last release 2026-08-06 (8 days) · last repo commit 2026-08-14 · 131 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 336,929 downloads/mo, #7,454 on PyPI
Alternatives
Verify before relying
pip install scrapingbee
from scrapingbee import ScrapingBeeClient
client = ScrapingBeeClient(api_key='YOUR-API-KEY')
response = client.html_api('https://example.com', params={'render_js': False})
print(response.content)- Pricing model and credit consumption rates for different API endpoints
- Rate limiting and concurrency constraints beyond the max_concurrency field in usage response
- Whether the SDK handles automatic retry logic for rate limits or only for 5XX responses
What it is and what it does
ScrapingBee is a Python client for a managed web scraping service that abstracts away the complexity of headless browsers, proxy rotation, and anti-bot detection. Instead of managing your own browser automation or proxy infrastructure, you instantiate a client with an API key and call methods like html_api(), google_search(), amazon_product(), or youtube_metadata() to fetch structured or raw data from target sites. The service handles rendering JavaScript, rotating proxies, and retrying failed requests on your behalf; you pay per request in API credits.
The SDK wraps requests and typing_extensions to provide a simple interface to ScrapingBee's endpoints. It supports both GET and POST requests, optional JavaScript rendering, screenshots, and an Auto-Mode feature that tries cheaper configurations first and charges only for the one that succeeds. Use it when you need reliable scraping without maintaining your own infrastructure, or when target sites require sophisticated anti-bot evasion that would be expensive to build yourself.
Use it for
- Scrape product listings and pricing from Amazon, Walmart, or other e-commerce sites for price monitoring or market research.
- Extract search results from Google or YouTube in bulk for SEO analysis, competitor research, or content aggregation.
- Retrieve HTML content from JavaScript-heavy websites that require a headless browser to render.
- Monitor web pages for changes or updates by periodically fetching and comparing HTML snapshots.
- Integrate web data collection into a data pipeline where you need reliable, proxy-rotated requests without managing infrastructure.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you need web scraping and can absorb the per-request API cost.
The SDK is actively maintained, has low install friction, and eliminates the operational burden of managing browsers and proxies. No, if you prefer open-source scraping tools (requests, BeautifulSoup, Scrapy) or cannot justify the recurring API charges. Yes-with-conditions if you're already using Scrapy—the package integrates via middleware, but you'll still incur per-request costs.
Install
scrapingbee on PyPI
Before you install
Low friction: pure Python wheel with only two lightweight runtime dependencies (requests and typing_extensions). Repository is actively maintained with a recent commit on 2026-08-14 and no archived status.
Requires a ScrapingBee API key (obtained by signing up at scrapingbee.com); API calls consume credits from your account.
License in practice
MIT license permits commercial and private use with minimal restrictions, making it suitable for most projects without legal friction.
Quickstart
pip install scrapingbee
from scrapingbee import ScrapingBeeClient
client = ScrapingBeeClient(api_key='YOUR-API-KEY')
response = client.html_api('https://example.com', params={'render_js': False})
print(response.content)Verify before relying
- Pricing model and credit consumption rates for different API endpoints
- Rate limiting and concurrency constraints beyond the max_concurrency field in usage response
- Whether the SDK handles automatic retry logic for rate limits or only for 5XX responses
Package facts
| License | MIT permissive |
| Python support | Supports the current Python release >=3.10 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 2 packagesrequeststyping_extensions |
| Maintenance | Actively maintained 8 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 336,929 / month, #7,454 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | License :: OSI Approved :: MIT LicenseProgramming Language :: PythonProgramming Language :: Python :: 3Programming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Programming Language :: Python :: 3.13Programming Language :: Python :: 3.14Topic :: Software Development :: Libraries :: Python Modules |
Evidence: scrapingbee-2.1.1-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “rotating proxy scraper”
- scrapingbeePython SDK wrapper for ScrapingBee's web scraping API, providing…
- free-proxyScrapes working free proxies from public proxy lists and returns them…
- oxylabsOfficial Python client for Oxylabs web scraping and proxy APIs,…
Give your agent the search over MCP, or paste the wish link into any chat.
More Python Modules packages
Converts domain names between Unicode and ASCII-compatible encoding (Punycode) according to IDNA 2008 and Unicode Technical Standard 46, with security validation and broader script coverage than the standard library.
Install it if you work with internationalized domain names, need to validate domains, or use HTTP clients that depend on it transitively.
Setuptools is a Python build backend and package management tool that handles building, distributing, and installing Python packages, including support for C/C++ extension modules.
PyYAML parses and emits YAML 1.1 data format, enabling serialization and deserialization of configuration files and Python objects to and from human-readable YAML text.
Pydantic validates Python data structures against type hints, coercing and checking input at runtime to ensure it matches a declared schema.
Provides reusable metadata objects for use with PEP-593 `typing.Annotated` to express common constraints like bounds, collection sizes, and predicates on types.
Install it if you use or build libraries that need to express type constraints in a standardized, inspectable way—or if you want to annotate your own types with…
Provides runtime tools to inspect and introspect Python type annotations, enabling programmatic examination of type hints at execution time.
See also scrapfly-sdk · zenrows · oxylabs · spider-client · scrapegraph-py · firecrawl · scrapinghub · firecrawl-py · googlesearch-python · scrapy-zyte-api