{"categories":[{"label":"Scientific/Engineering","url":"https://skillfed.io/packages/category/scientific-engineering/3"}],"enrichment":{"capability":"Chinese word segmentation for spaCy with domain-specific models (news, web, medicine, tourism) and optional part-of-speech tagging.","skillfed_tags":["chinese-nlp","spacy-integration","domain-segmentation"],"use_cases":["Segment Chinese news articles or web text where domain-specific accuracy matters more than generic tokenization.","Build spaCy NLP pipelines for Chinese that need both word boundaries and part-of-speech labels in one step.","Process medical or tourism domain Chinese documents with models trained on domain-specific corpora.","Batch-process large Chinese text files with multiprocessing to split into words and optionally tag parts of speech.","Extend spaCy's Chinese support with a higher-accuracy alternative to generic tokenizers when domain context is known."],"what_it_does":"spacy-pkuseg is a spaCy-integrated fork of the pkuseg Chinese word segmentation toolkit. It provides domain-aware tokenization for Chinese text across five pretrained models: a mixed-domain default, plus specialized models for news, web, medicine, and tourism text. The package wraps the underlying segmentation engine (unmodified from the original pkuseg) and simplifies both installation and model serialization for spaCy workflows.\n\nThe toolkit supports optional part-of-speech tagging alongside segmentation, batch processing of files with multiprocessing, and user-defined custom dictionaries. It depends on numpy and srsly for numerical and serialization operations. Installation is straightforward via pip with precompiled wheels for modern Python versions and common platforms, though it carries medium friction due to compiled components.","worth_installing":"Yes, if you need Chinese word segmentation in a spaCy pipeline or want domain-specific accuracy. The package is actively maintained, has no known vulnerabilities, supports modern Python versions, and offers pretrained models for multiple domains. Install friction is moderate but manageable. Not necessary if you only need generic Chinese tokenization or are not using spaCy."},"id":"spacy-pkuseg","links":{"html":"https://skillfed.io/packages/spacy-pkuseg","md":"https://skillfed.io/packages/spacy-pkuseg.md","pypi":"https://pypi.org/project/spacy-pkuseg/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2025-07-14","license_spdx":null,"license_treatment":"permissive","name":"spacy-pkuseg","python_support":"supports_current","summary":"Chinese word segmentation toolkit for spaCy (fork of pkuseg-python)"},"popularity":{"monthly_downloads":702717,"position":5283,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"1.0.1"}