{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/9"},{"label":"Linguistic","url":"https://skillfed.io/packages/category/text-processing-linguistic/2"}],"enrichment":{"capability":"Measures Korean speech-to-text accuracy using character error rate (CER), word error rate (WER), character correct rate (CRR), and entity preservation metrics with reproducible evaluation reports.","skillfed_tags":["korean-nlp","speech-recognition","evaluation-metrics"],"use_cases":["Compare accuracy of cloud STT services (Azure Speech, Amazon Transcribe, Google Cloud Speech-to-Text) using a consistent Korean-aware metric","Evaluate open-source speech recognition models (Whisper, FunASR) against reference transcripts with standard CER/WER formulas","Track preservation of named entities and product names in STT output using entity-specific CER and F1 scores","Reproduce historical evaluation results by maintaining the default normalized calculation mode across versions","Analyze error patterns (substitutions, deletions, insertions) to diagnose STT failure modes in Korean text"],"what_it_does":"nlptutti is a Python package for evaluating Korean speech-to-text output against reference transcripts. It computes character error rate (CER), word error rate (WER), character correct rate (CRR), and entity/keyword preservation metrics by calculating substitutions, deletions, and insertions from Levenshtein minimum edit distance. The package supports both plain strings and structured formats (JSON, SRT, TSV) and offers two calculation modes: a normalized formula (default, for backward compatibility) and a standard formula (for model comparisons and published benchmarks).\n\nThe package handles Korean-specific concerns including punctuation removal, Unicode normalization options for combining characters, and word-boundary handling across different tokenization policies. It can evaluate single sentence pairs, entire corpora with micro/macro aggregation, named entities and keywords against provided dictionaries, and error patterns. Results include detailed edit operation counts and optional provenance tracking (SHA-256, package version, actual calculation parameters) for reproducibility.","worth_installing":"Yes. Active, recently released package with low install friction, permissive MIT license, no known vulnerabilities, and a focused scope solving a real problem for Korean STT evaluation. The single dependency (jiwer) is lightweight. Best for teams evaluating Korean speech recognition systems or comparing STT services; less relevant if you work exclusively with non-Korean languages."},"id":"nlptutti","links":{"html":"https://skillfed.io/packages/nlptutti","md":"https://skillfed.io/packages/nlptutti.md","pypi":"https://pypi.org/project/nlptutti/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-12","license_spdx":null,"license_treatment":"permissive","name":"nlptutti","python_support":"supports_current","summary":"Korean STT CER, WER, and CRR metrics with explicit normalization and reproducible reports"},"popularity":{"monthly_downloads":112676,"position":12362,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"0.0.0.19"}