{"categories":[{"label":"Linguistic","url":"https://skillfed.io/packages/category/text-processing-linguistic/3"}],"enrichment":{"capability":"Normalizes Bangla Unicode text by fixing invalid character sequences, handling legacy symbols, and optionally preserving English text.","skillfed_tags":["bangla-nlp","unicode-repair","indic-languages"],"use_cases":["Clean user-generated Bangla text before indexing into search engines or databases.","Preprocess Bangla corpora for NLP model training by removing invalid Unicode sequences.","Normalize Bangla text from OCR or legacy encoding sources that may contain malformed characters.","Audit text quality by inspecting the operations log to understand what normalization was applied.","Handle mixed Bangla\u2013English documents by selectively normalizing only the Bangla portions."],"what_it_does":"bnunicodenormalizer is a Bangla-specific Unicode normalization library that repairs malformed or invalid Bangla text sequences. It identifies and corrects character-level issues\u2014such as orphaned diacritics, invalid Unicode combinations, and legacy symbol mappings\u2014and returns both the normalized output and a detailed log of operations performed.\n\nThe package is designed for Bangla text preprocessing in NLP pipelines, data cleaning, and linguistic analysis. It offers configurable handling of legacy Bangla symbols (with custom remapping), optional preservation of English alphanumerics and punctuation, and operation-level transparency so you can audit what changed and why. No external dependencies are required.","worth_installing":"Yes, if you work with Bangla text and need character-level normalization. The package is lightweight, dependency-free, and permissively licensed. Dormancy is a minor concern\u2014no active development since mid-2024\u2014but the absence of vulnerabilities and straightforward scope (Unicode repair, not a moving target) make it low-risk for stable use. Verify Python version compatibility and test against your specific Bangla text patterns before production deployment."},"id":"bnunicodenormalizer","links":{"html":"https://skillfed.io/packages/bnunicodenormalizer","md":"https://skillfed.io/packages/bnunicodenormalizer.md","pypi":"https://pypi.org/project/bnunicodenormalizer/"},"maintenance":{"status":"dormant"},"meta":{"latest_release":"2024-05-26","license_spdx":null,"license_treatment":"permissive","name":"bnunicodenormalizer","python_support":"unspecified","summary":"Bangla Unicode Normalization Toolkit"},"popularity":{"monthly_downloads":90136,"position":13616,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"0.1.7"}