--- id: simplemma version: "2.0.0" license: MIT License license_treatment: permissive maintenance: active --- # simplemma — Fast and zero-dependency lemmatization, tokenization and sentence splitting for 54 languages. License: permissive · Maintenance: active · Downloads: 220.5K/mo ## What it is and what it does Simplemma is a pure-Python lemmatizer that reduces inflected word forms to their base dictionary forms across 54 languages. It works offline with no model downloads, ships in a 19 MB package, and includes built-in tokenization, sentence splitting, and language detection utilities. The core trade-off is deliberate: it sacrifices the accuracy of neural pipelines (typically a few percentage points behind trained models) in exchange for speed (millions of tokens per second), simplicity, and a small footprint that suits low-resource settings, teaching, and baseline NLP work. Unlike stemming, lemmatization always returns valid linguistic forms. Simplemma handles this without morphosyntactic information by performing dictionary lookups on raw token sequences. It supports language chaining to improve coverage when a word is unknown in one language but recognized in another, and offers a tunable RAM footprint via a `low_memory` flag or optional marisa-trie backend. The package is actively maintained, has no runtime dependencies, and works on current Python versions (3.10+). Use it for: - Build a search engine or text indexing system where lemmatization reduces vocabulary size without downloading language models. - Preprocess multilingual documents for topic modeling or information retrieval in resource-constrained environments. - Teach NLP fundamentals in a classroom setting where a simple, dependency-free tool is easier to install and explain than neural pipelines. - Establish a baseline lemmatization result to compare against more complex models in morphological analysis research. - Detect the language of short text snippets by scoring them against a set of candidate languages. - Tokenize and split sentences in a rule-based pipeline where speed and determinism matter more than state-of-the-art accuracy. ## Worth the install? AI-flagged interpretation of the facts above — verify before relying. Simplemma converts inflected word forms to their dictionary base forms (lemmas) across 54 languages using pure Python with no external dependencies or model downloads. Yes. Simplemma is worth installing if you need fast, offline lemmatization across many languages without external dependencies or model downloads. Its zero-dependency design, active maintenance, MIT license, and absence of known vulnerabilities make it a low-risk choice. Install it for baseline NLP work, teaching, or low-resource settings; do not install it if you need the highest accuracy and can afford the overhead of neural pipelines. ## Install pip install simplemma uv add simplemma poetry add simplemma ## Installing simplemma Before you install: Installation is straightforward with zero runtime dependencies and a 19 MB footprint. The package is actively maintained with a recent release (2 days old) and no known vulnerabilities. License in practice: MIT License permits unrestricted use, modification, and distribution in both open-source and commercial contexts with minimal obligations. Quickstart: pip install simplemma import simplemma simplemma.lemmatize('masks', lang='en') # 'mask' simplemma.text_lemmatizer('Hier sind Vaccines.', lang=('de', 'en')) # ['hier', 'sein', 'vaccine', '.'] Requires Python 3.10 or later; simplemma==1.1.2 is the last version supporting 3.8 and 3.9. Verify before relying: - Whether accuracy figures (0.91–0.97 for 34 languages, 0.85–0.90 for morphologically rich ones) remain current across all 54 languages in version 2.0.0. - Whether the ~1.9M tokens/s (German) and ~3.4M (English) throughput claims hold in real-world workloads outside the benchmarks cited. - Whether optional marisa-trie dependency (for lowest memory usage) is compatible with all 54 languages or has language-specific limitations. ## Package facts - License: MIT License (permissive) - Python support: supports_current - Install friction: low - Maintenance: active - Downloads: 220.5K/month (top 15,000 on PyPI) - Known vulnerabilities: none known ## Tags multilingual lemmatization, lemmatizer no dependencies, fast lemmatization python, offline lemmatization, tokenization sentence splitting, language detection, morphological analysis, multilingual, offline-first, zero-dependencies [View on SkillFed](https://skillfed.io/packages/simplemma) · [View on PyPI](https://pypi.org/project/simplemma/)