{"categories":[{"label":"General","url":"https://skillfed.io/packages/category/text-processing-general"}],"enrichment":{"capability":"Provides Python bindings to compute standard Information Retrieval evaluation measures (MAP, NDCG, and others) against relevance judgments, wrapping the TREC trec_eval tool.","skillfed_tags":["information-retrieval","evaluation-metrics","research-tool"],"use_cases":["Evaluate information retrieval systems in Python research pipelines without reimplementing standard metrics.","Compute ranking quality metrics (MAP, NDCG, etc.) for search or recommendation system experiments.","Perform statistical significance testing between two ranked result sets using standard IR measures.","Validate IR models by scoring ranked results against ground-truth relevance judgments in batch."],"what_it_does":"pytrec_eval is a Python wrapper around TREC's trec_eval tool, a standard reference implementation for computing Information Retrieval evaluation metrics. It lets you compute measures like MAP (Mean Average Precision) and NDCG (Normalized Discounted Cumulative Gain) by passing relevance judgments and ranked results as Python dictionaries, then get back computed scores for each query.\n\nThe package is designed to eliminate the need for custom metric implementations in Python research code. It wraps the compiled trec_eval engine via C++ bindings, so it inherits the correctness and performance of the reference implementation. Installation requires a C++ compiler and Python development headers; the package has been dormant since 2020 but carries no known security issues.","worth_installing":"Yes, if you need standard IR evaluation metrics in Python and can meet the C++ build requirements. The package is dormant but stable, carries no known vulnerabilities, and wraps a trusted reference implementation. Install only if you're comfortable with a package that hasn't been updated since 2020 and verify compatibility with your Python version before relying on it in production."},"id":"pytrec-eval","links":{"html":"https://skillfed.io/packages/pytrec-eval","md":"https://skillfed.io/packages/pytrec-eval.md","pypi":"https://pypi.org/project/pytrec-eval/"},"maintenance":{"status":"dormant"},"meta":{"latest_release":"2020-09-07","license_spdx":null,"license_treatment":"permissive","name":"pytrec-eval","python_support":"supports_current","summary":"Provides Python bindings for popular Information Retrieval measures implemented within trec_eval."},"popularity":{"monthly_downloads":96187,"position":13224,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"0.5"}