---
id: scrapingbee
version: "2.1.1"
license: MIT
license_treatment: permissive
maintenance: active
---

# scrapingbee — ScrapingBee Python SDK

License: permissive · Maintenance: active · Downloads: 336.9K/mo

## What it is and what it does

ScrapingBee is a Python client for a managed web scraping service that abstracts away the complexity of headless browsers, proxy rotation, and anti-bot detection. Instead of managing your own browser automation or proxy infrastructure, you instantiate a client with an API key and call methods like html_api(), google_search(), amazon_product(), or youtube_metadata() to fetch structured or raw data from target sites. The service handles rendering JavaScript, rotating proxies, and retrying failed requests on your behalf; you pay per request in API credits.

The SDK wraps requests and typing_extensions to provide a simple interface to ScrapingBee's endpoints. It supports both GET and POST requests, optional JavaScript rendering, screenshots, and an Auto-Mode feature that tries cheaper configurations first and charges only for the one that succeeds. Use it when you need reliable scraping without maintaining your own infrastructure, or when target sites require sophisticated anti-bot evasion that would be expensive to build yourself.

Use it for:

- Scrape product listings and pricing from Amazon, Walmart, or other e-commerce sites for price monitoring or market research.
- Extract search results from Google or YouTube in bulk for SEO analysis, competitor research, or content aggregation.
- Retrieve HTML content from JavaScript-heavy websites that require a headless browser to render.
- Monitor web pages for changes or updates by periodically fetching and comparing HTML snapshots.
- Integrate web data collection into a data pipeline where you need reliable, proxy-rotated requests without managing infrastructure.

## Worth the install?

AI-flagged interpretation of the facts above — verify before relying.

Python SDK wrapper for ScrapingBee's web scraping API, providing methods to scrape HTML, search results, product data, and interact with AI endpoints via a managed proxy and headless browser service.

Yes, if you need web scraping and can absorb the per-request API cost. The SDK is actively maintained, has low install friction, and eliminates the operational burden of managing browsers and proxies. No, if you prefer open-source scraping tools (requests, BeautifulSoup, Scrapy) or cannot justify the recurring API charges. Yes-with-conditions if you're already using Scrapy—the package integrates via middleware, but you'll still incur per-request costs.

## Install

pip install scrapingbee
uv add scrapingbee
poetry add scrapingbee

## Installing scrapingbee

Before you install: Low friction: pure Python wheel with only two lightweight runtime dependencies (requests and typing_extensions). Repository is actively maintained with a recent commit on 2026-08-14 and no archived status.

License in practice: MIT license permits commercial and private use with minimal restrictions, making it suitable for most projects without legal friction.

Quickstart:

pip install scrapingbee

from scrapingbee import ScrapingBeeClient

client = ScrapingBeeClient(api_key='YOUR-API-KEY')
response = client.html_api('https://example.com', params={'render_js': False})
print(response.content)

Requires a ScrapingBee API key (obtained by signing up at scrapingbee.com); API calls consume credits from your account.

Verify before relying:

- Pricing model and credit consumption rates for different API endpoints
- Rate limiting and concurrency constraints beyond the max_concurrency field in usage response
- Whether the SDK handles automatic retry logic for rate limits or only for 5XX responses

## Package facts

- License: MIT (permissive)
- Python support: supports_current
- Install friction: low
- Maintenance: active
- Downloads: 336.9K/month (top 15,000 on PyPI)
- Known vulnerabilities: none known

## Tags

web scraping api client, headless browser scraping, rotating proxy scraper, google search scraping, amazon product scraping, youtube metadata extraction, web data extraction sdk, web-scraping, api-client, data-extraction

[View on SkillFed](https://skillfed.io/packages/scrapingbee) · [View on PyPI](https://pypi.org/project/scrapingbee/)