{"categories":[{"label":"WWW/HTTP","url":"https://skillfed.io/packages/category/internet-www-http/4"}],"enrichment":{"capability":"Parses and scrapes HTML from web pages using a simple, intuitive API built on top of requests, with support for CSS selectors, XPath, JavaScript rendering, and async operations.","skillfed_tags":["web-scraping","html-parsing","dormant"],"use_cases":["Extract all links from a web page for crawling or analysis without manually parsing HTML.","Scrape structured data (product names, prices, metadata) from websites using CSS or XPath selectors.","Render and scrape JavaScript-heavy pages that require a browser engine to populate content.","Build async scrapers that fetch multiple pages concurrently to speed up data collection.","Parse HTML responses in a requests-based workflow without switching to a separate parsing library."],"what_it_does":"requests-html is a web scraping and HTML parsing library that wraps the requests library with parsing capabilities. It lets you fetch web pages and extract data using CSS selectors (jQuery-style), XPath, or direct link enumeration. The library includes mocked user-agent headers, automatic redirect following, connection pooling, and cookie persistence\u2014all the conveniences of requests plus parsing.\n\nThe package supports both synchronous and asynchronous workflows, and includes JavaScript rendering via pyppeteer for pages that require client-side execution. It's designed for developers who want to scrape or parse HTML without learning a heavy framework, though its dormant maintenance status (last release 2019-02-17) means it receives no active updates or security patches.","worth_installing":"Yes, if you need simple HTML parsing and scraping for a one-off project or legacy codebase already using requests. No, if you're starting a new scraping project\u2014the dormant maintenance (last release 2019, no active development) means you won't get bug fixes, security updates, or compatibility improvements for modern websites. Consider actively maintained alternatives like BeautifulSoup with requests, or Scrapy for larger projects."},"id":"requests-html","links":{"html":"https://skillfed.io/packages/requests-html","md":"https://skillfed.io/packages/requests-html.md","pypi":"https://pypi.org/project/requests-html/"},"maintenance":{"status":"dormant"},"meta":{"latest_release":"2019-02-17","license_spdx":null,"license_treatment":"permissive","name":"requests-html","python_support":"supports_current","summary":"HTML Parsing for Humans."},"popularity":{"monthly_downloads":488419,"position":6381,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"0.10.0"}
