{"categories":[{"label":"Linguistic","url":"https://skillfed.io/packages/category/text-processing-linguistic/2"}],"enrichment":{"capability":"Detects sentence boundaries in text across many languages using lightweight 8-bit quantized ONNX models, splitting raw text into individual sentences.","skillfed_tags":["nlp","multilingual","onnx"],"use_cases":["Preprocessing multilingual text corpora for NLP pipelines that require sentence-level input.","Splitting user-submitted text into sentences for downstream tasks like translation, sentiment analysis, or named-entity recognition.","Building text processing workflows that need language-aware sentence segmentation without heavy ML frameworks.","Tokenizing documents in low-resource or embedded environments where model size and speed matter.","Handling historical or non-standard text (Ancient Greek, Old French, Sanskrit) where rule-based splitters fail."],"what_it_does":"MiniSBD is a Python library for sentence boundary detection that splits raw text into individual sentences. It uses quantized ONNX models\u2014the same models as Stanza but converted to ONNX format and compressed\u2014to achieve fast, lightweight inference without heavy dependencies. The library supports a large set of languages and can run on CPU or GPU via onnxruntime.\n\nYou instantiate a detector with a language code (e.g., \"en\", \"fr\", \"ja\"), then call its sentences() method on text to get an iterable of detected sentences. Models are cached locally after first download. You can also supply a custom ONNX model path or change the cache directory at runtime. The package is free and open source under AGPLv3.","worth_installing":"Yes, if you need fast multilingual sentence segmentation and can accept AGPLv3 licensing. The package is lightweight, actively maintained, has no known vulnerabilities, and supports modern Python versions. Install friction is low. Main caveat: AGPLv3 requires source-code sharing for network deployments; review your use case before adopting in proprietary services."},"id":"minisbd","links":{"html":"https://skillfed.io/packages/minisbd","md":"https://skillfed.io/packages/minisbd.md","pypi":"https://pypi.org/project/minisbd/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-03-03","license_spdx":null,"license_treatment":"agpl","name":"minisbd","python_support":"supports_current","summary":"Free and open source library for fast sentence boundary detection"},"popularity":{"monthly_downloads":245515,"position":8730,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"0.9.5"}