mir-eval
Common metrics for common audio/music processing tasks.
What it is and what it does
mir_eval is a Python library that implements standard evaluation metrics used in music and audio information retrieval research. It provides reference implementations of common accuracy measures for audio signal processing problems. The library depends on numpy, scipy, and decorator, making it straightforward to integrate into research workflows and evaluation pipelines.
The package is designed for researchers and practitioners who need to benchmark audio processing algorithms against established metrics. Rather than reimplementing evaluation logic, users can call mir_eval's functions to compute metrics consistently and reproducibly, which is especially valuable when comparing results across papers or validating new methods against published baselines.
Use it for:
- Evaluate audio processing algorithms by computing standard metrics against ground truth annotations.
- Benchmark music processing systems using standardized accuracy measures from the mir_eval library.
- Validate audio analysis results by computing evaluation metrics across research projects.
- Compare results across papers using transparent, reference implementations of common MIR metrics.
Worth the install?
AI-flagged interpretation of the facts on this page — verify before relying
mir_eval computes standard accuracy metrics for music and audio information retrieval tasks, enabling transparent evaluation of audio processing algorithms.
Yes. mir_eval is actively maintained, has no known vulnerabilities, installs with low friction, and provides standard reference implementations for music information retrieval metrics. Install it if you are evaluating audio or music processing algorithms and need reproducible metric computation.
Install
mir-eval on PyPI
pip
pip install mir-evaluv
uv add mir-evalpoetry
poetry add mir-evalInstalling mir-eval
Before you install
Low friction installation with three stable dependencies (numpy, scipy, decorator). Active maintenance with recent commits and a 710-star repository; last release was 2025-02-25.
License in practice
MIT license is permissive, allowing use in commercial and proprietary projects with minimal restrictions beyond attribution.
Quickstart
pip install mir-eval
import mir_eval
# Call mir_eval functions to compute metrics for your audio processing task
Verify before relying
- Whether the library supports specific MIR tasks like beat tracking, chord recognition, and source separation evaluation.
- Whether mir_eval provides F-measure, precision, recall, or other specific metric types.
Package facts
| License | MIT (permissive) |
| Python support | not specified |
| Install friction | low — pure-Python wheel |
| Runtime dependencies | 3 — numpy, scipy, decorator |
| Maintenance | actively maintained — 535 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 229,671/month — #9,127 on PyPI (30-day window, as of 2026-08-14) |
| Known vulnerabilities | none known (OSV.dev, checked 2026-08-14) |
Evidence: mir_eval-0.8.2-py3-none-any.whl
Tags
More Analysis packages
Pydub provides a high-level Python interface…
permissive · top 5,000 on PyPI
librosalibrosa provides audio and music signal…
permissive · top 5,000 on PyPI
soxrPerforms high-quality sample-rate conversion…
copyleft · top 5,000 on PyPI
moviepyMoviePy is a Python library for video editing…
permissive · top 5,000 on PyPI
tinytagReads metadata (artist, title, duration,…
permissive · top 5,000 on PyPI
kaldiioKaldiio reads and writes Kaldi archive (ark)…
unclear · top 5,000 on PyPI
music21music21 is a Python toolkit for analyzing,…
permissive · top 15,000 on PyPI
ir-measuresProvides a unified Python interface to compute…
permissive · top 15,000 on PyPI
seqevalseqeval evaluates the performance of sequence…
permissive · top 15,000 on PyPI
pytrec-eval-terrierProvides Python bindings to TREC's trec_eval…
permissive · top 5,000 on PyPI
ranxranx computes ranking evaluation metrics…
permissive · top 15,000 on PyPI
pretty-midiProvides utilities for reading, modifying, and…
permissive · top 15,000 on PyPI
symusicsymusic parses and transforms MIDI and ABC…
permissive · top 15,000 on PyPI
pytrec-evalProvides Python bindings to compute standard…
permissive · top 15,000 on PyPI
sacrebleuSacreBLEU computes BLEU, chrF, and TER scores…
permissive · top 5,000 on PyPI