scrapy-zyte-api
Client library to process URLs through Zyte API
Decision gist · record as of 2026-08-14
Yes, if you are already using Scrapy and need to scrape JavaScript-heavy or bot-protected sites without building custom infrastructure. The low install friction and active maintenance make it straightforward to integrate. However, you must have a Zyte API account and be comfortable with the service's pricing model, as all requests route through their infrastructure. Not necessary if you're scraping simple HTML-only sites or already have your own proxy and rendering setup.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires Python 3.10 or later; Zyte API account and credentials needed to make actual requests.
- Low install friction with four straightforward runtime dependencies.
- Active maintenance with a recent release 49 days ago and ongoing repository activity; currently in Beta status.
License · maintenance · safety
BSD-3-Clause (permissive) — BSD-3-Clause is permissive and places minimal restrictions on use, modification, or redistribution for both open-source and commercial projects.
last release 2026-06-26 (49 days) · last repo commit 2026-07-24 · 43 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 111,960 downloads/mo, #12,388 on PyPI
Alternatives
Verify before relying
pip install scrapy-zyte-api
from scrapy_zyte_api import ScrapyZyteAPIDownloadHandler
# Configure in settings.py or pass to spider
DOWNLOAD_HANDLERS = {'https': 'scrapy_zyte_api.ScrapyZyteAPIDownloadHandler'}- Whether Zyte API credentials or account setup is required before the plugin can be used
- Performance characteristics and cost implications of routing requests through Zyte's infrastructure
- Specific Scrapy versions supported beyond the Python version requirements
What it is and what it does
scrapy-zyte-api is a Scrapy middleware plugin that bridges Scrapy spiders to Zyte's managed web scraping API. It handles the integration layer, allowing you to configure Zyte API features (like JavaScript rendering, proxy rotation, and anti-bot handling) directly within your Scrapy project without building custom HTTP logic.
The plugin depends on scrapy, zyte-api, packaging, and typing-extensions. It targets modern Python (3.10–3.13) and is actively maintained. You configure it as a download handler in your Scrapy settings, then requests flow through Zyte's infrastructure instead of making direct connections. This is useful when you need robust handling of JavaScript-heavy sites, IP rotation, or sites with aggressive bot detection, but it introduces a dependency on Zyte's service and pricing model.
Use it for
- Scraping JavaScript-rendered content by routing requests through Zyte's rendering service without writing custom browser automation.
- Rotating through residential proxies and managing anti-bot evasion as part of your Scrapy pipeline without external proxy configuration.
- Processing large-scale scraping jobs where you want Zyte to handle infrastructure, rate limiting, and IP management.
- Testing Scrapy spiders against sites with aggressive bot detection by leveraging Zyte's managed evasion capabilities.
- Simplifying multi-region scraping by using Zyte's geolocation features integrated directly into your spider configuration.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you are already using Scrapy and need to scrape JavaScript-heavy or bot-protected sites without building custom infrastructure.
The low install friction and active maintenance make it straightforward to integrate. However, you must have a Zyte API account and be comfortable with the service's pricing model, as all requests route through their infrastructure. Not necessary if you're scraping simple HTML-only sites or already have your own proxy and rendering setup.
Install
scrapy-zyte-api on PyPI
Before you install
Low install friction with four straightforward runtime dependencies. Active maintenance with a recent release 49 days ago and ongoing repository activity; currently in Beta status.
Requires Python 3.10 or later; Zyte API account and credentials needed to make actual requests.
License in practice
BSD-3-Clause is permissive and places minimal restrictions on use, modification, or redistribution for both open-source and commercial projects.
Quickstart
pip install scrapy-zyte-api
from scrapy_zyte_api import ScrapyZyteAPIDownloadHandler
# Configure in settings.py or pass to spider
DOWNLOAD_HANDLERS = {'https': 'scrapy_zyte_api.ScrapyZyteAPIDownloadHandler'}Verify before relying
- Whether Zyte API credentials or account setup is required before the plugin can be used
- Performance characteristics and cost implications of routing requests through Zyte's infrastructure
- Specific Scrapy versions supported beyond the Python version requirements
Package facts
| License | BSD-3-Clause permissive |
| Python support | Supports the current Python release >=3.10 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 4 packagespackagingscrapytyping-extensionszyte-api |
| Maintenance | Actively maintained 49 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 111,960 / month, #12,388 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Development Status :: 4 - BetaIntended Audience :: DevelopersNatural Language :: EnglishOperating System :: OS IndependentProgramming Language :: PythonProgramming Language :: Python :: 3Programming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Programming Language :: Python :: 3.13 |
Evidence: scrapy_zyte_api-0.35.0-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “scrapy zyte api integration”
- scrapy-zyte-apiScrapy plugin that integrates Zyte API for web scraping, allowing you…
- zyte-apiPython client library and command-line tool for Zyte API, providing…
- ScrapyScrapy is a web scraping framework that extracts structured data from…
Give your agent the search over MCP, or paste the wish link into any chat.
More WWW/HTTP packages
urllib3 is an HTTP client library that provides thread-safe connection pooling, SSL/TLS verification, multipart file uploads, request retries, compression support, and proxy handling for Python applications.
Requests is a Python HTTP library that simplifies sending HTTP/1.1 requests with automatic handling of headers, authentication, cookies, and response parsing.
h11 is a pure-Python HTTP/1.1 protocol implementation that handles parsing and serializing HTTP messages without any built-in I/O, letting you integrate it with any network layer you choose.
HTTPX is a fully featured HTTP client library for Python that provides both sync and async APIs, with support for HTTP/1.1 and HTTP/2, plus an integrated command-line client.
Install it if you are building new projects or modernizing existing ones that rely on HTTP.
A minimal low-level HTTP client library that sends HTTP requests with thread-safe and task-safe connection pooling, supporting HTTP/1.1, HTTP/2, proxies, and both sync and async interfaces.
aiohttp is an async HTTP client and server framework built on asyncio, supporting both WebSockets and middleware-based routing for building concurrent web applications.
Install it if you need async HTTP client or server capabilities in asyncio-based applications.
See also zyte-api · Scrapy · scrapfly-sdk · scrapingbee · scrapy-playwright · scrapling · scrapegraph-py · scrapy-impersonate · scrapinghub · zenrows