$npx skillfedfor your agent

Janome

Japanese morphological analysis engine.

With conditionsPyPI LinguisticReleased Jul 2023380.3K downloads / moAL2Pure Python

Decision gist · record as of 2026-08-14

pure-Python wheel — Janome-0.5.0-py2.py3-none-any.whl
v0.5.0 · released 2023-07-01

Yes, if you need to process Japanese text in Python. Janome is a mature, actively maintained, permissively licensed tool with no known vulnerabilities and low install friction. It's the right choice for projects that require Japanese morphological analysis without external system dependencies. Not relevant for non-Japanese text processing.AI-flagged interpretation of the facts on this page — verify before relying

Before you install

  • Python 3.7+ is required.
  • Low install friction; the package is a pure Python wheel.
  • Note that building from source consumes about 500 MB of memory during installation.

License · maintenance · safety

AL2 (permissive) — Licensed under Apache License 2.0 (permissive). The package also uses the MeCab-IPADIC dictionary and statistical model; see LICENSE.txt and NOTICE.txt for full details.

last release 2023-07-01 (1140 days) · last repo commit 2026-06-07 · 914 stars

0 known vulnerabilities (OSV.dev, 2026-08-14) · 380,325 downloads/mo, #7,103 on PyPI

Verify before relying

pip install janome

from janome.tokenizer import Tokenizer
t = Tokenizer()
for token in t.tokenize('すもももももももものうち'):
    print(token)
  • Whether the MeCab-IPADIC dictionary license imposes additional constraints beyond Apache 2.0 for commercial use.
  • Current memory requirements for typical production workloads beyond the noted 500 MB build-time consumption.
  • Performance characteristics and throughput on large-scale Japanese text processing tasks.
Same gist for agents: .md · .json

What it is and what it does

Janome is a morphological analyzer for Japanese text that runs entirely in Python without external compiled dependencies. It tokenizes Japanese sentences and annotates each token with part-of-speech tags and grammatical information using the MeCab-IPADIC dictionary. The package is designed for developers who need to process Japanese text in Python applications without installing system-level NLP tools.

The analyzer works by segmenting Japanese text (which lacks spaces between words) into meaningful tokens and providing linguistic metadata for each. It's used in search, text mining, and NLP pipelines where understanding the grammatical structure of Japanese is necessary. The package has been actively maintained since 2015 and remains in beta status.

Use it for

  • Tokenize Japanese text for search indexing or full-text search applications.
  • Extract part-of-speech information for Japanese language NLP tasks like sentiment analysis or text classification.
  • Build Japanese text preprocessing pipelines for machine learning models that require morphological features.
  • Analyze Japanese documents to identify nouns, verbs, and other grammatical elements for content analysis.
  • Segment Japanese user input in chatbots or voice assistants before semantic processing.

Worth the install?

AI-flagged interpretation of the facts on this page. Verify before relying on it.

With conditions

Yes, if you need to process Japanese text in Python.

Janome is a mature, actively maintained, permissively licensed tool with no known vulnerabilities and low install friction. It's the right choice for projects that require Japanese morphological analysis without external system dependencies. Not relevant for non-Japanese text processing.

Install

janome on PyPI

Before you install

Low install friction; the package is a pure Python wheel. Note that building from source consumes about 500 MB of memory during installation.

Python 3.7+ is required.

License in practice

Licensed under Apache License 2.0 (permissive). The package also uses the MeCab-IPADIC dictionary and statistical model; see LICENSE.txt and NOTICE.txt for full details.

Quickstart

pip install janome

from janome.tokenizer import Tokenizer
t = Tokenizer()
for token in t.tokenize('すもももももももものうち'):
    print(token)

Verify before relying

  • Whether the MeCab-IPADIC dictionary license imposes additional constraints beyond Apache 2.0 for commercial use.
  • Current memory requirements for typical production workloads beyond the noted 500 MB build-time consumption.
  • Performance characteristics and throughput on large-scale Japanese text processing tasks.

Package facts

LicenseAL2 permissive
Python supportNot specified
Install frictionLow. Pure-Python wheel
Runtime dependenciesNone
MaintenanceActively maintained 1,140 days since the last release
Last repo commit
First released
Downloads380,325 / month, #7,103 on PyPI 30-day window, as of 2026-08-14
Known vulnerabilitiesNone known OSV.dev, checked 2026-08-14
Classifiers
Development Status :: 4 - BetaLicense :: OSI Approved :: Apache Software LicenseNatural Language :: JapaneseProgramming Language :: Python :: 3.10Programming Language :: Python :: 3.7Programming Language :: Python :: 3.8Programming Language :: Python :: 3.9

Evidence: Janome-0.5.0-py2.py3-none-any.whl

Tags

Capabilities
japanese text tokenizationjapanese morphological analysisjapanese nlp tokenizerjapanese word segmentationjapanese pos taggingjapanese language processing
Topics
japanese-nlptext-tokenization

Let your AI agent find packages like this

Example. Real query, live index.

An agent finds packages by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language. Give your agent the search over MCP.

More Linguistic packages

charset-normalizer Worth it
PyPI · Utilities · released Aug 2026

Detects and normalizes text encoding from unknown or ambiguous sources, supporting all IANA character sets that Python's core library provides codecs for, with the ability to register custom codecs.

permissive licensepure Python · 3.7+
1.7Bdownloads / mo
tiktoken Worth it
PyPI · Linguistic · released May 2026

tiktoken is a fast BPE tokenizer that converts text into token sequences compatible with OpenAI models, supporting multiple encoding schemes including o200k_base and model-specific encodings.

Install it if you work with OpenAI APIs or need to understand token boundaries in GPT-family models.

permissive licensecompiled wheel · 3.9+
233.0Mdownloads / mo
chardet Worth it
PyPI · Python Modules · released Aug 2026

Detects character encoding and language in byte sequences with high accuracy, supporting 99 encodings and returning confidence scores, language tags, and MIME types.

Install it if you need to detect character encoding or language in byte data; the rewrite makes it substantially faster and more accurate than its predecessors.

0BSDpure Python · 3.10+
199.0Mdownloads / mo
text-unidecode With conditions
PyPI · Python Modules · released Aug 2019

Converts Unicode text to ASCII by transliterating non-ASCII characters into their closest ASCII equivalents, with no runtime dependencies.

However, if transliteration quality or ongoing maintenance matters, consider unidecode instead despite its GPL-only license.

GPL-2.0-or-laterpure Pythonabandoned
89.0Mdownloads / mo
lark Worth it
PyPI · Python Modules · released Oct 2025

Lark is a parsing library that builds abstract syntax trees from context-free grammars, supporting multiple parsing algorithms (Earley, LALR(1), CYK) with automatic line and column tracking.

MITpure Python · 3.8+
79.7Mdownloads / mo
tree-sitter Worth it
PyPI · Linguistic · released Jun 2026

Python bindings to the tree-sitter parsing library, enabling incremental parsing and syntax tree analysis for source code.

MITcompiled wheel · 3.10+
79.0Mdownloads / mo

See also konoha · tinysegmenter · nagisa · mecab-python3 · SudachiPy · ja-ginza · mecab · rhoknp · ipadic · fugashi