SudachiDict-core
Sudachi Dictionary for SudachiPy - Core Edition
Decision gist · record as of 2026-08-14
Yes, if you are building Japanese NLP applications with SudachiPy. The core edition offers a practical balance of vocabulary coverage and download size. Install friction is minimal, maintenance is active, and the Apache-2.0 license poses no restrictions. Verify that your SudachiPy version is compatible and that network access during installation is available.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires SudachiPy to be installed separately; files are downloaded during installation via setup.py, which may require network access.
- Low install friction; a pure Python wheel with no compiled dependencies.
- Actively maintained with recent releases; the repository shows ongoing development.
License · maintenance · safety
Apache-2.0 (permissive) — Licensed under Apache-2.0 (permissive), allowing free use, modification, and distribution with minimal restrictions—suitable for both open-source and commercial projects.
last release 2026-07-24 (21 days) · last repo commit 2026-07-24 · 305 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 2,139,899 downloads/mo, #3,258 on PyPI
Alternatives
Verify before relying
pip install sudachidict_core
from sudachipy.tokenizer import Tokenizer
from sudachipy.dictionary import Dictionary
dictionary = Dictionary.open()
tokenizer = Tokenizer(dictionary)
tokens = tokenizer.tokenize("テキスト")- Whether dictionary files are downloaded during installation or require manual setup steps beyond pip install
- Total footprint and resource requirements after installation
- Compatibility with specific SudachiPy versions and whether version mismatches cause runtime errors
What it is and what it does
SudachiDict-core is a dictionary resource package for the Sudachi morphological analyzer, distributed as a Python package for convenient installation alongside SudachiPy. It contains the core edition of Sudachi's linguistic data—word lists, part-of-speech tags, and inflection rules—needed to perform Japanese text tokenization and morphological analysis. The package downloads resources during installation rather than bundling them directly, keeping the wheel manageable.
You install it via pip alongside SudachiPy, then pass it to SudachiPy's tokenizer to analyze Japanese text. The core edition strikes a balance between coverage and download size, making it suitable for most Japanese NLP tasks. Three editions are available (small, core, full); this package provides the middle-ground core variant.
Use it for
- Tokenizing Japanese text into morphemes for downstream NLP tasks like named entity recognition or sentiment analysis
- Building Japanese search engines or text indexing systems that require accurate word segmentation
- Analyzing Japanese documents in data pipelines where morphological analysis is a preprocessing step
- Developing chatbots or language models that need to understand Japanese word boundaries and grammatical structure
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you are building Japanese NLP applications with SudachiPy.
The core edition offers a practical balance of vocabulary coverage and download size. Install friction is minimal, maintenance is active, and the Apache-2.0 license poses no restrictions. Verify that your SudachiPy version is compatible and that network access during installation is available.
Install
sudachidict-core on PyPI
Before you install
Low install friction; a pure Python wheel with no compiled dependencies. Actively maintained with recent releases; the repository shows ongoing development.
Requires SudachiPy to be installed separately; files are downloaded during installation via setup.py, which may require network access.
License in practice
Licensed under Apache-2.0 (permissive), allowing free use, modification, and distribution with minimal restrictions—suitable for both open-source and commercial projects.
Quickstart
pip install sudachidict_core
from sudachipy.tokenizer import Tokenizer
from sudachipy.dictionary import Dictionary
dictionary = Dictionary.open()
tokenizer = Tokenizer(dictionary)
tokens = tokenizer.tokenize("テキスト")Verify before relying
- Whether dictionary files are downloaded during installation or require manual setup steps beyond pip install
- Total footprint and resource requirements after installation
- Compatibility with specific SudachiPy versions and whether version mismatches cause runtime errors
Package facts
| License | Apache-2.0 permissive |
| Python support | Not specified |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 1 packageSudachiPy |
| Maintenance | Actively maintained 21 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 2,139,899 / month, #3,258 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
Evidence: sudachidict_core-20260723-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “sudachi dictionary core”
- SudachiDict-coreProvides the core edition of the Sudachi morphological analyzer…
- SudachiDict-fullProvides the full-edition Sudachi dictionary resource for Japanese…
- SudachiDict-smallProvides the small-edition Sudachi dictionary resource for SudachiPy,…
Give your agent the search over MCP, or paste the wish link into any chat.
More Linguistic packages
Detects and normalizes text encoding from unknown or ambiguous sources, supporting all IANA character sets that Python's core library provides codecs for, with the ability to register custom codecs.
tiktoken is a fast BPE tokenizer that converts text into token sequences compatible with OpenAI models, supporting multiple encoding schemes including o200k_base and model-specific encodings.
Install it if you work with OpenAI APIs or need to understand token boundaries in GPT-family models.
Detects character encoding and language in byte sequences with high accuracy, supporting 99 encodings and returning confidence scores, language tags, and MIME types.
Install it if you need to detect character encoding or language in byte data; the rewrite makes it substantially faster and more accurate than its predecessors.
Converts Unicode text to ASCII by transliterating non-ASCII characters into their closest ASCII equivalents, with no runtime dependencies.
However, if transliteration quality or ongoing maintenance matters, consider unidecode instead despite its GPL-only license.
Lark is a parsing library that builds abstract syntax trees from context-free grammars, supporting multiple parsing algorithms (Earley, LALR(1), CYK) with automatic line and column tracking.
Python bindings to the tree-sitter parsing library, enabling incremental parsing and syntax tree analysis for source code.
See also SudachiDict-full · SudachiDict-small · SudachiPy · ja-ginza · ginza · ipadic · mecab-python3 · Janome · rhoknp · unidic-lite