SudachiDict-core

What it is and what it does

SudachiDict-core is a dictionary resource package for the Sudachi morphological analyzer, distributed as a Python package for convenient installation alongside SudachiPy. It contains the core edition of Sudachi's linguistic data—word lists, part-of-speech tags, and inflection rules—needed to perform Japanese text tokenization and morphological analysis. The package downloads resources during installation rather than bundling them directly, keeping the wheel manageable.

You install it via pip alongside SudachiPy, then pass it to SudachiPy's tokenizer to analyze Japanese text. The core edition strikes a balance between coverage and download size, making it suitable for most Japanese NLP tasks. Three editions are available (small, core, full); this package provides the middle-ground core variant.

Use it for:

• Tokenizing Japanese text into morphemes for downstream NLP tasks like named entity recognition or sentiment analysis
• Building Japanese search engines or text indexing systems that require accurate word segmentation
• Analyzing Japanese documents in data pipelines where morphological analysis is a preprocessing step
• Developing chatbots or language models that need to understand Japanese word boundaries and grammatical structure

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Provides the core edition of the Sudachi morphological analyzer dictionary for use with SudachiPy, enabling Japanese text tokenization and linguistic analysis.

Yes, if you are building Japanese NLP applications with SudachiPy. The core edition offers a practical balance of vocabulary coverage and download size. Install friction is minimal, maintenance is active, and the Apache-2.0 license poses no restrictions. Verify that your SudachiPy version is compatible and that network access during installation is available.

Install

sudachidict-core on PyPI

pip install sudachidict-core

uv add sudachidict-core

poetry add sudachidict-core

Installing SudachiDict-core

Before you install

Low install friction; a pure Python wheel with no compiled dependencies. Actively maintained with recent releases; the repository shows ongoing development.

License in practice

Licensed under Apache-2.0 (permissive), allowing free use, modification, and distribution with minimal restrictions—suitable for both open-source and commercial projects.

Quickstart

pip install sudachidict_core

from sudachipy.tokenizer import Tokenizer
from sudachipy.dictionary import Dictionary

dictionary = Dictionary.open()
tokenizer = Tokenizer(dictionary)
tokens = tokenizer.tokenize("テキスト")

Requires SudachiPy to be installed separately; files are downloaded during installation via setup.py, which may require network access.

Verify before relying

• Whether dictionary files are downloaded during installation or require manual setup steps beyond pip install
• Total footprint and resource requirements after installation
• Compatibility with specific SudachiPy versions and whether version mismatches cause runtime errors

Package facts

Evidence: sudachidict_core-20260723-py3-none-any.whl

Tags

More Linguistic packages