Resiliparse
A collection of robust and fast processing tools for parsing and analyzing (not only) web archive data.
Decision gist · record as of 2026-08-14
Yes, if you work with web archives or WARC files. Resiliparse is actively maintained, carries no known vulnerabilities, and offers pre-built wheels for supported platforms. Medium install friction is acceptable for the performance and robustness it provides. The permissive Apache-2.0 license poses no restrictions. Not relevant if you don't need web archive processing.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires Python >=3.8; building from source requires vcpkg and C++ build tools.
- Medium install friction due to compiled Rust and C++ components; pre-built wheels available for modern Python versions on macOS, Linux, and Windows.
- Active maintenance with recent releases; last commit 2026-07-20.
License · maintenance · safety
Apache-2.0 (permissive) — Apache-2.0 permissive license allows commercial use, modification, and distribution with minimal restrictions; suitable for most projects.
last release 2026-07-20 (25 days) · last repo commit 2026-07-20 · 144 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 1,317,625 downloads/mo, #4,067 on PyPI
Alternatives
Verify before relying
pip install resiliparse
import resiliparse
# See https://resiliparse.chatnoir.eu for detailed usage examples- Specific parsing capabilities and API surface beyond 'web archive data' are not detailed in the fact sheet.
- Performance characteristics compared to alternative web parsing libraries are not documented.
- Integration patterns with fastwarc and typical workflows are not shown in the excerpt.
- Which specific Python versions have pre-built wheels available beyond the friction evidence shown.
What it is and what it does
Resiliparse is a collection of parsing and analysis tools for web archive data, built with Rust and C++ for performance and wrapped with Python bindings. It is part of the ChatNoir web analytics toolkit and depends on fastwarc for WARC file handling. The package is designed to handle large-scale web archive processing efficiently, with pre-built binaries available for supported platforms.
The library targets developers and researchers working with web crawl data, Common Crawl archives, and similar large-scale web datasets. Installation is straightforward via pip for supported platforms; building from source requires vcpkg and C++ tooling but is documented. The project is actively maintained and carries no known security vulnerabilities.
Use it for
- Parse and extract content from WARC (Web ARChive) files at scale for research or analytics.
- Process Common Crawl data or other large web archives for information extraction pipelines.
- Build web analytics and data mining workflows that require efficient HTML and metadata parsing.
- Integrate web archive processing into data science or NLP projects that need robust, fast parsing.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you work with web archives or WARC files.
Resiliparse is actively maintained, carries no known vulnerabilities, and offers pre-built wheels for supported platforms. Medium install friction is acceptable for the performance and robustness it provides. The permissive Apache-2.0 license poses no restrictions. Not relevant if you don't need web archive processing.
Install
resiliparse on PyPI
Before you install
Medium install friction due to compiled Rust and C++ components; pre-built wheels available for modern Python versions on macOS, Linux, and Windows. Active maintenance with recent releases; last commit 2026-07-20.
Requires Python >=3.8; building from source requires vcpkg and C++ build tools.
License in practice
Apache-2.0 permissive license allows commercial use, modification, and distribution with minimal restrictions; suitable for most projects.
Quickstart
pip install resiliparse
import resiliparse
# See https://resiliparse.chatnoir.eu for detailed usage examplesVerify before relying
- Specific parsing capabilities and API surface beyond 'web archive data' are not detailed in the fact sheet.
- Performance characteristics compared to alternative web parsing libraries are not documented.
- Integration patterns with fastwarc and typical workflows are not shown in the excerpt.
- Which specific Python versions have pre-built wheels available beyond the friction evidence shown.
Package facts
| License | Apache-2.0 permissive |
| Python support | Supports the current Python release >=3.8 |
| Install friction | Medium. Platform-specific wheel |
| Runtime dependencies | 1 packagefastwarc |
| Maintenance | Actively maintained 25 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 1,317,625 / month, #4,067 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
Evidence: resiliparse-1.0.9-cp310-cp310-macosx_12_0_arm64.whl; resiliparse-1.0.9-cp310-cp310-macosx_12_0_x86_64.whl; resiliparse-1.0.9-cp310-cp310-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl; resiliparse-1.0.9-cp310-cp310-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl; resiliparse-1.0.9-cp310-cp310-win_amd64.whl; resiliparse-1.0.9-cp311-cp311-macosx_12_0_arm64.whl; resiliparse-1.0.9-cp311-cp311-macosx_12_0_x86_64.whl; resiliparse-1.0.9-cp311-cp311-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl; resiliparse-1.0.9-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl; resiliparse-1.0.9-cp311-cp311-win_amd64.whl; resiliparse-1.0.9-cp312-cp312-macosx_12_0_arm64.whl; resiliparse-1.0.9-cp312-cp312-macosx_12_0_x86_64.whl; resiliparse-1.0.9-cp312-cp312-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl; resiliparse-1.0.9-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl; resiliparse-1.0.9-cp312-cp312-win_amd64.whl; resiliparse-1.0.9-cp313-cp313-macosx_12_0_arm64.whl; resiliparse-1.0.9-cp313-cp313-macosx_12_0_x86_64.whl; resiliparse-1.0.9-cp313-cp313-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl; resiliparse-1.0.9-cp313-cp313-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl; resiliparse-1.0.9-cp313-cp313-win_amd64.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “web archive parsing”
- ResiliparseResiliparse provides fast, robust parsing and analysis tools for web…
- FastWARCFastWARC parses WARC (Web ARChive) files—compressed or…
- warc3-wet-clueweb09Reads and iterates over WARC and WET archive files, extracting…
Give your agent the search over MCP, or paste the wish link into any chat.
More WWW/HTTP packages
urllib3 is an HTTP client library that provides thread-safe connection pooling, SSL/TLS verification, multipart file uploads, request retries, compression support, and proxy handling for Python applications.
Requests is a Python HTTP library that simplifies sending HTTP/1.1 requests with automatic handling of headers, authentication, cookies, and response parsing.
h11 is a pure-Python HTTP/1.1 protocol implementation that handles parsing and serializing HTTP messages without any built-in I/O, letting you integrate it with any network layer you choose.
HTTPX is a fully featured HTTP client library for Python that provides both sync and async APIs, with support for HTTP/1.1 and HTTP/2, plus an integrated command-line client.
Install it if you are building new projects or modernizing existing ones that rely on HTTP.
A minimal low-level HTTP client library that sends HTTP requests with thread-safe and task-safe connection pooling, supporting HTTP/1.1, HTTP/2, proxies, and both sync and async interfaces.
aiohttp is an async HTTP client and server framework built on asyncio, supporting both WebSockets and middleware-based routing for building concurrent web applications.
Install it if you need async HTTP client or server capabilities in asyncio-based applications.
See also FastWARC · warc3-wet-clueweb09 · warc3-wet · moviepilot-rust · ar · fastar · sqlfluffrs · webcolors · Crawl4AI · kornia-rs