{"categories":[{"label":"Scientific/Engineering","url":"https://skillfed.io/packages/category/scientific-engineering/2"},{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/2"},{"label":"Text Processing","url":"https://skillfed.io/packages/category/text-processing"}],"enrichment":{"capability":"SacreBLEU computes BLEU, chrF, and TER scores for machine translation evaluation with automatic test set management and reproducible, comparable results across systems.","skillfed_tags":["machine-translation","evaluation-metrics","nlp-research"],"use_cases":["Score machine translation system outputs against standard WMT benchmarks without manually downloading or preprocessing test sets","Compare BLEU scores across different papers and systems using the reproducible version signature to ensure methodological consistency","Evaluate translation quality using multiple metrics (BLEU, chrF, TER) in a single command with consistent tokenization","Perform statistical significance testing on paired translation outputs to determine if improvements are meaningful","Integrate MT evaluation into research pipelines via the Python API for automated scoring of experimental outputs"],"what_it_does":"SacreBLEU wraps the original BLEU reference implementation with added conveniences for machine translation research. It computes BLEU, chrF, chrF++, and TER metrics on detokenized text, handling tokenization automatically according to WMT standards. The package automatically downloads and manages common test sets (like wmt14, wmt17, wmt21) so you can score against them by name rather than hunting down local files. It outputs results with a version signature that documents exactly how the score was computed, making cross-paper comparisons straightforward.\n\nThe tool works both as a command-line utility and as a Python library. It supports multiple tokenizers including language-specific ones for Japanese and Chinese, performs statistical significance testing via paired bootstrap resampling and approximate randomization, and defaults to JSON output (with a text format option for backward compatibility). Dependencies include portalocker, regex, tabulate, numpy, colorama, and lxml for various scoring and output formatting tasks.","worth_installing":"Yes. SacreBLEU is actively maintained, has no security vulnerabilities, installs with low friction, and is the standard tool for reproducible machine translation evaluation in the research community. The Apache-2.0 license poses no restrictions. Install it if you work with machine translation evaluation, benchmark scoring, or need comparable BLEU/chrF/TER metrics across systems."},"id":"sacrebleu","links":{"html":"https://skillfed.io/packages/sacrebleu","md":"https://skillfed.io/packages/sacrebleu.md","pypi":"https://pypi.org/project/sacrebleu/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-01-12","license_spdx":"Apache-2.0","license_treatment":"permissive","name":"sacrebleu","python_support":"supports_current","summary":"Hassle-free computation of shareable, comparable, and reproducible BLEU, chrF, and TER scores"},"popularity":{"monthly_downloads":4139155,"position":2372,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"2.6.0"}