$npx skillfedfor your agent

jieba

Chinese Words Segmentation Utilities

With conditionsPyPI Text ProcessingReleased Jan 20202.4M downloads / moMITSource build

Decision gist · record as of 2026-08-14

sdist only — jieba-0.42.1.tar.gz · builds from source
v0.42.1 · released 2020-01-20

Yes, with conditions. Jieba remains the de facto standard for Chinese word segmentation in Python and has proven reliability for its core task. However, install it only if you are working with Chinese text and can verify compatibility with your Python version—the package is dormant and may not work on very recent Python releases without testing. Check the GitHub repository for community forks or patches if you encounter issues.AI-flagged interpretation of the facts on this page — verify before relying

Before you install

  • No runtime dependencies, but package is dormant since 2020 and Python version support is unspecified; compatibility with modern Python versions is uncertain.
  • High install friction: the package is dormant (last release January 2020, last commit August 2024) and has not been updated for years.
  • Despite 35112 GitHub stars and 2.4M monthly downloads, the lack of recent maintenance and unspecified Python version support create uncertainty about compatibility with current Python releases.

License · maintenance · safety

MIT (permissive) — MIT license is permissive and imposes no restrictions on use, modification, or distribution in proprietary or open-source projects.

last release 2020-01-20 (2398 days) · last repo commit 2024-08-21 · 35,112 stars

0 known vulnerabilities (OSV.dev, 2026-08-14) · 2,395,652 downloads/mo, #3,083 on PyPI

Verify before relying

pip install jieba

import jieba
result = jieba.cut('我爱自然语言处理')
print(list(result))
  • Whether the package works reliably on Python 3.8 and later versions given the lack of updates since 2020.
  • Whether the built-in dictionary is current for modern Chinese usage and terminology.
  • Performance characteristics and memory usage for large-scale text segmentation tasks.
Same gist for agents: .md · .json

What it is and what it does

Jieba is a Chinese text segmentation library that breaks Chinese sentences into individual words. It offers three segmentation modes: precise mode for accurate analysis, full mode for exhaustive word extraction, and search-engine mode for improved recall in retrieval tasks. The library supports both simplified and traditional Chinese, allows users to inject custom dictionaries, and has no external runtime dependencies.

The package is widely used in Chinese NLP pipelines but has been dormant since January 2020. While it maintains high GitHub visibility and download counts, the lack of recent maintenance means it may have compatibility issues with modern Python versions and may not reflect current Chinese language conventions or terminology.

Use it for

  • Tokenizing Chinese text for machine learning models that require word-level input features.
  • Building Chinese search engines or information retrieval systems using search-engine segmentation mode.
  • Preprocessing Chinese documents for NLP analysis, sentiment analysis, or text classification tasks.
  • Extracting keywords from Chinese text by combining segmentation with frequency analysis.
  • Processing domain-specific Chinese text by adding custom words to the dictionary.

Worth the install?

AI-flagged interpretation of the facts on this page. Verify before relying on it.

With conditions

Yes, with conditions.

Jieba remains the de facto standard for Chinese word segmentation in Python and has proven reliability for its core task. However, install it only if you are working with Chinese text and can verify compatibility with your Python version—the package is dormant and may not work on very recent Python releases without testing. Check the GitHub repository for community forks or patches if you encounter issues.

Install

jieba on PyPI

Before you install

High install friction: the package is dormant (last release January 2020, last commit August 2024) and has not been updated for years. Despite 35112 GitHub stars and 2.4M monthly downloads, the lack of recent maintenance and unspecified Python version support create uncertainty about compatibility with current Python releases.

No runtime dependencies, but package is dormant since 2020 and Python version support is unspecified; compatibility with modern Python versions is uncertain.

License in practice

MIT license is permissive and imposes no restrictions on use, modification, or distribution in proprietary or open-source projects.

Quickstart

pip install jieba

import jieba
result = jieba.cut('我爱自然语言处理')
print(list(result))

Verify before relying

  • Whether the package works reliably on Python 3.8 and later versions given the lack of updates since 2020.
  • Whether the built-in dictionary is current for modern Chinese usage and terminology.
  • Performance characteristics and memory usage for large-scale text segmentation tasks.

Package facts

LicenseMIT permissive
Python supportNot specified
Install frictionHigh. Source build required
Runtime dependenciesNone
MaintenanceDormant 2,398 days since the last release
Last repo commit
First released
Downloads2,395,652 / month, #3,083 on PyPI 30-day window, as of 2026-08-14
Known vulnerabilitiesNone known OSV.dev, checked 2026-08-14
Classifiers
Intended Audience :: DevelopersLicense :: OSI Approved :: MIT LicenseNatural Language :: Chinese (Simplified)Natural Language :: Chinese (Traditional)Operating System :: OS IndependentProgramming Language :: PythonProgramming Language :: Python :: 2Programming Language :: Python :: 2.6Programming Language :: Python :: 2.7Programming Language :: Python :: 3Programming Language :: Python :: 3.2Programming Language :: Python :: 3.3Programming Language :: Python :: 3.4Topic :: Text ProcessingTopic :: Text Processing :: IndexingTopic :: Text Processing :: Linguistic

Evidence: jieba-0.42.1.tar.gz

Tags

Capabilities
chinese text segmentationchinese word tokenizationjieba chinese nlpchinese language processingchinese text analysisword segmentation chinese
Topics
chinese-nlptext-segmentation
PyPI keywords
NLP

Let your AI agent find packages like this

Example. Real query, live index.

You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.

wish › “chinese text segmentation”

  • jiebaJieba segments Chinese text into words using multiple algorithms…
  • jieba3kPerforms Chinese word segmentation, breaking Chinese text into…
  • spacy-pkusegChinese word segmentation for spaCy with domain-specific models…

Give your agent the search over MCP, or paste the wish link into any chat.

More Text Processing packages

regex Worth it
PyPI · Python Modules · released Jul 2026

A drop-in replacement for Python's standard `re` module that adds advanced regex features like nested sets, fuzzy matching, lookaround in conditionals, and full Unicode case-folding while maintaining backward compatibility.

Apache-2.0 AND CNRI-Pythoncompiled wheel · 3.10+
437.7Mdownloads / mo
pyparsing Worth it
PyPI · Text Processing · released Jan 2026

pyparsing provides a library for building text parsers directly in Python code using composable grammar classes, handling quoted strings, whitespace variation, and embedded comments without regex or lex/yacc.

Install it if you need to parse text or define grammars programmatically.

MITpure Python · 3.9+
412.7Mdownloads / mo
fonttools Worth it
PyPI · Text Processing · released May 2026

fonttools manipulates font files in multiple formats (TrueType, OpenType, AFM, Type 1, Mac-specific) and includes TTX, a tool to convert fonts to and from XML text format.

Install it if you need to read, write, or manipulate fonts programmatically or via the TTX command-line tool.

permissive licensepure Python · 3.10+
235.9Mdownloads / mo
docutils With conditions
PyPI · Software Development · released May 2026

Docutils converts plaintext documentation in reStructuredText format into multiple output formats including HTML, XML, and LaTeX using a modular processing system.

BSD-3-Clausepure Python · 3.9+
225.6Mdownloads / mo
RapidFuzz Worth it
PyPI · Text Processing · released Apr 2026

RapidFuzz provides fast fuzzy string matching using Levenshtein Distance and related metrics, implemented mostly in C++ with Python bindings for rapid similarity scoring and approximate string matching.

Install it if you need fuzzy string matching; it's a solid replacement for FuzzyWuzzy with better licensing and performance.

MITcompiled wheel · 3.10+
184.2Mdownloads / mo
tinycss2 Worth it
PyPI · Text Processing · released Nov 2025

tinycss2 parses CSS strings into token and block objects, and generates CSS strings from those objects, following the CSS Syntax Level 3 specification without enforcing specific properties or values.

Install it if your project requires CSS tokenization or syntax manipulation.

BSD-3-Clausepure Python · 3.10+
113.2Mdownloads / mo

See also jieba3k · spacy-pkuseg · rjieba · wordninja · nagisa · rouge-chinese · tinysegmenter · wordsegment · OpenCC · bpemb