{"categories":[{"label":"XML","url":"https://skillfed.io/packages/category/text-processing-markup-xml"},{"label":"Indexing/Search","url":"https://skillfed.io/packages/category/internet-www-http-indexing-search"},{"label":"Indexing","url":"https://skillfed.io/packages/category/text-processing-indexing"}],"enrichment":{"capability":"Parses and crawls sitemaps in multiple formats (XML, RSS, Atom, plain text, Google News/Image) and extracts URLs efficiently without loading entire trees into memory.","skillfed_tags":["web-crawling","sitemap-discovery","xml-parsing"],"use_cases":["Discover all pages on a website by parsing its sitemap hierarchy for web crawling or SEO audits.","Extract URLs from Google News or Image sitemaps for specialized content indexing.","Build a site map inventory by recursively following nested sitemap references.","Integrate sitemap discovery into a web scraper to respect site structure and robots.txt directives.","Analyze sitemap coverage to identify missing or orphaned pages in a website."],"what_it_does":"Ultimate Sitemap Parser is a Python library that discovers and parses sitemaps in all common formats\u2014XML, RSS, Atom, plain text, and Google News/Image variants\u2014and extracts URLs into an object tree. It handles malformed sitemaps gracefully, discovers sitemaps linked from robots.txt, and uses memory-efficient Expat XML parsing to avoid loading entire hierarchies into memory at once.\n\nThe library is designed for web crawlers and indexing workflows. You give it a homepage URL, and it returns a tree of sitemap objects you can iterate over to get all discovered pages. It has been field-tested with approximately 1 million URLs as part of the Media Cloud project and depends only on python-dateutil and requests, making installation straightforward on any modern Python environment.","worth_installing":"Yes. The library is actively maintained, has low install friction, no known vulnerabilities, and solves a specific problem well\u2014parsing diverse sitemap formats reliably. The copyleft GPL-3.0-or-later license is the main constraint: use it freely in open-source projects, but review licensing implications before bundling into proprietary software."},"id":"ultimate-sitemap-parser","links":{"html":"https://skillfed.io/packages/ultimate-sitemap-parser","md":"https://skillfed.io/packages/ultimate-sitemap-parser.md","pypi":"https://pypi.org/project/ultimate-sitemap-parser/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-06-16","license_spdx":"GPL-3.0-or-later","license_treatment":"copyleft","name":"ultimate-sitemap-parser","python_support":"supports_current","summary":"A performant library for parsing and crawling sitemaps"},"popularity":{"monthly_downloads":198401,"position":9731,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"1.8.1"}