scrapinghub

What it is and what it does

Scrapinghub is a Python 3.10+ client library that wraps the Scrapinghub API, allowing developers to programmatically manage and interact with web scraping jobs and data hosted on the Scrapinghub cloud platform. It abstracts HTTP communication through a clean Python interface, handling authentication, request formatting, and response parsing. The library depends on requests for HTTP calls, retrying for resilient network operations, python-dotenv for credential management, and six for Python 2/3 compatibility (legacy support).

Typically used by teams running distributed web scraping operations who need to automate job submission, monitor execution, retrieve results, or integrate scraping workflows into larger data pipelines. The library is production-stable, actively maintained, and supports modern Python implementations including CPython and PyPy.

Use it for:

• Automate submission and monitoring of web scraping jobs to Scrapinghub from a Python application or workflow.
• Retrieve and process scraped data programmatically from completed Scrapinghub jobs within a data pipeline.
• Manage multiple scraping projects and jobs at scale through a unified Python interface.
• Integrate Scrapinghub scraping capabilities into CI/CD pipelines or scheduled data collection tasks.
• Build custom dashboards or reporting tools that pull job status and results from Scrapinghub.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

A Python client library for communicating with the Scrapinghub API, enabling programmatic access to Scrapinghub's web scraping and data extraction services.

Yes, if you use Scrapinghub for web scraping. The library is production-stable, actively maintained, has low install friction, permissive licensing, and no known vulnerabilities. It is the official client for Scrapinghub API integration in Python and is well-suited for teams automating scraping workflows. Not relevant if you do not use Scrapinghub's platform.

Install

scrapinghub on PyPI

pip install scrapinghub

uv add scrapinghub

poetry add scrapinghub

Installing scrapinghub

Before you install

Installation is straightforward with low friction; the package is actively maintained with a recent release and supports current Python versions (3.10–3.13). Four runtime dependencies are all stable, widely-used libraries.

License in practice

BSD license is permissive, allowing commercial and private use with minimal restrictions—no licensing barrier to adoption.

Quickstart

pip install scrapinghub

import scrapinghub
# Authenticate and interact with Scrapinghub API
client = scrapinghub.Client(apikey='your-api-key')

Requires Python 3.10 or later; Scrapinghub API credentials (API key) needed for actual use.

Verify before relying

• Specific API endpoints and methods available in version 2.9.0—documentation should be consulted for full capability scope.
• Whether optional MessagePack support (mentioned in description) is included by default or requires separate installation.

Package facts

Evidence: scrapinghub-2.9.0-py2.py3-none-any.whl

Tags

More WWW/HTTP packages