{"categories":[{"label":"Scientific/Engineering","url":"https://skillfed.io/packages/category/scientific-engineering/5"},{"label":"Python Modules","url":"https://skillfed.io/packages/category/software-development-libraries-python-modules/15"},{"label":"Utilities","url":"https://skillfed.io/packages/category/utilities/7"},{"label":"Linguistic","url":"https://skillfed.io/packages/category/text-processing-linguistic/2"},{"label":"General","url":"https://skillfed.io/packages/category/text-processing-general"}],"enrichment":{"capability":"Efficiently parse and stream-process MediaWiki XML database dumps with memory-conscious iteration and optional distributed processing across multiple files.","skillfed_tags":["mediawiki","xml-parsing","streaming"],"use_cases":["Extract revision history and metadata from Wikipedia or other MediaWiki dumps for linguistic or historical analysis.","Process multiple large XML dump files in parallel to build indexes or data warehouses from wiki content.","Stream through a dump file to filter and extract specific pages or revisions without loading the entire file into memory.","Analyze edit patterns, contributor activity, or content evolution by iterating over revisions in a structured way.","Build data pipelines that consume wiki dumps as input for downstream NLP or machine learning workflows."],"what_it_does":"mwxml is a Python library for processing MediaWiki XML database dumps\u2014the raw XML exports that contain Wikipedia and other wiki content. It addresses two core problems: the complexity of parsing large XML files and the performance overhead of naive approaches. The library provides a simple iterator interface that streams through dump files without loading them entirely into memory, making it practical to process dumps that would otherwise exhaust available RAM.\n\nThe package also supports distributed processing, allowing you to work with multiple dump files in parallel. It depends on mwtypes, mwcli, para, and jsonschema to handle MediaWiki-specific data types, command-line utilities, parallelization, and schema validation. It's designed for developers and researchers who need to extract, analyze, or transform content from wiki database exports.","worth_installing":"Yes. The package is actively maintained, has no known vulnerabilities, installs with low friction, and solves a real problem for anyone working with MediaWiki dumps. The MIT license imposes no restrictions. Install it if you need to process wiki database exports; skip it if you're not working with MediaWiki XML data."},"id":"mwxml","links":{"html":"https://skillfed.io/packages/mwxml","md":"https://skillfed.io/packages/mwxml.md","pypi":"https://pypi.org/project/mwxml/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-04-08","license_spdx":null,"license_treatment":"permissive","name":"mwxml","python_support":"unspecified","summary":"A set of utilities for processing MediaWiki XML dump data."},"popularity":{"monthly_downloads":249574,"position":8648,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"0.3.8"}
