{"categories":[{"label":"Linguistic","url":"https://skillfed.io/packages/category/text-processing-linguistic/2"}],"enrichment":{"capability":"Provides the UniDic 2.3.0 Japanese morphological dictionary for use with MeCab-based tokenizers, requiring a separate download step and consuming approximately 1GB of disk space.","skillfed_tags":["japanese-nlp","morphological-analysis","mecab-dictionary"],"use_cases":["Japanese NLP pipelines that need detailed morphological analysis beyond basic part-of-speech tags, such as lemmatization or conjugation-type identification.","Building Japanese text processing systems that require the full UniDic annotation set for linguistic research or production NLP.","Japanese language learning or corpus analysis tools that benefit from rich lemma and pronunciation data.","Accent analysis and standard-language pronunciation research using the aType and kana fields in UniDic.","Counting-expression parsing in Japanese text, using the specialized iConType and fConType fields for numeric and counter contexts."],"what_it_does":"unidic-py packages the UniDic 2.3.0 Japanese morphological dictionary for pip installation. UniDic is a comprehensive lexical resource maintained by NINJAL (the National Institute for Japanese Language and Linguistics) that includes detailed linguistic annotations for Japanese words: part-of-speech tags, conjugation types, lemmas, pronunciations, etymological categories, and accent information. The package itself is a thin wrapper; after installation, you must run `python -m unidic download` to fetch the dictionary data from AWS, which takes up approximately 1GB of disk space.\n\nOnce installed, unidic exposes the DICDIR constant to locate the dictionary. The package includes minor modifications from the official UniDic release (additions for \u4ee4\u548c, removal of single-character numeric/alphabetic entries, and changes to unknown-punctuation handling) to improve usability in Python workflows. It is designed to work with MeCab-based tokenizers that can accept a dictionary path argument.","worth_installing":"Yes, if you need full Japanese morphological analysis and are willing to accept the 1GB disk footprint and the two-step installation process (pip install + manual download). The dictionary is comprehensive and well-maintained by NINJAL. No, if you want a lightweight solution\u2014the package explicitly recommends unidic-lite as an alternative. The aging maintenance status (last release 2021-10-10) is a minor concern but not a blocker, since the dictionary data is stable and the code is minimal."},"id":"unidic","links":{"html":"https://skillfed.io/packages/unidic","md":"https://skillfed.io/packages/unidic.md","pypi":"https://pypi.org/project/unidic/"},"maintenance":{"status":"aging"},"meta":{"latest_release":"2021-10-10","license_spdx":null,"license_treatment":"permissive","name":"unidic","python_support":"supports_current","summary":"UniDic packaged for Python"},"popularity":{"monthly_downloads":416399,"position":6820,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"1.1.0"}
