{"categories":[{"label":"Python Modules","url":"https://skillfed.io/packages/category/software-development-libraries-python-modules/8"},{"label":"Utilities","url":"https://skillfed.io/packages/category/utilities/4"}],"enrichment":{"capability":"Reads and writes WARC (Web ARChive) and legacy ARC format files used in web archiving, with streaming support for both local and remote archives.","skillfed_tags":["web-archiving","streaming-io","standards-compliant"],"use_cases":["Extract URLs and content from archived WARC files for analysis or migration to other systems","Capture HTTP/HTTPS traffic from web scraping scripts directly into WARC files for reproducible archiving","Convert legacy ARC archives to modern WARC format while preserving record metadata","Stream remote WARC files over HTTP without downloading them entirely to disk first","Build web archival pipelines that read, filter, and rewrite WARC records in a single pass"],"what_it_does":"Warcio is a streaming library for reading and writing WARC and ARC archive formats used in web preservation. It provides fast, low-level access to web archival content through an iterator-based API, allowing you to process records one at a time without loading entire archives into memory. The library supports both WARC 1.0 and WARC 1.1 ISO standards, handles on-the-fly ARC-to-WARC conversion, and automatically decompresses and de-chunks HTTP payloads. It also includes HTTP capture functionality that monkey-patches Python's http.client to write requests and responses directly to WARC files, integrating well with the requests library.\n\nThe package is designed for web archivists, digital preservation workflows, and applications that need to read or create web archives. It originated as a component of the Webrecorder project and is maintained as a standalone library. With only six as an external dependency and pure Python distribution, it installs cleanly across Python 3.8+ versions.","worth_installing":"Yes. Warcio is production-stable, actively maintained, has no known vulnerabilities, and installs with minimal friction. Install it if you need to read or write WARC/ARC archives or capture HTTP traffic into web archives."},"id":"warcio","links":{"html":"https://skillfed.io/packages/warcio","md":"https://skillfed.io/packages/warcio.md","pypi":"https://pypi.org/project/warcio/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-03-31","license_spdx":null,"license_treatment":"permissive","name":"warcio","python_support":"unspecified","summary":"Streaming WARC (and ARC) IO library"},"popularity":{"monthly_downloads":919403,"position":4721,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"1.8.1"}
