--- id: properscoring version: "0.1" license: Apache license_treatment: permissive maintenance: abandoned --- # properscoring — Proper scoring rules in Python License: permissive · Maintenance: abandoned · Downloads: 167.2K/mo ## What it is and what it does Properscoring is a Python library for computing strictly proper scoring rules—evaluation metrics that cannot be artificially improved through hedging—making them fair and reliable for assessing the accuracy of probabilistic forecasts. It implements Continuous Ranked Probability Score (CRPS) and Brier Score in multiple forms: CRPS can be calculated exactly for Gaussian distributions, via numerical integration for arbitrary distributions, from finite ensemble samples, or weighted by probability density values; Brier Score is provided for binary forecasts and threshold exceedances. All functions handle multi-dimensional arrays and missing values (NaN). The library was created by researchers at The Climate Corporation and is particularly useful in weather forecasting and other domains where probabilistic predictions need rigorous evaluation. It requires external dependencies and optional Numba support for performance improvements on ensemble-based calculations. However, the package is no longer actively maintained—the last release and commit occurred years ago—so compatibility with recent Python versions may be limited. Use it for: - Evaluate weather forecast model accuracy by computing CRPS scores across many observations and comparing to baseline forecasts. - Calculate skill scores to measure forecast improvement relative to a baseline, normalized to a 0–1 scale. - Score ensemble forecasts from climate or weather models using finite samples without requiring the underlying distribution. - Compute Brier scores for binary probabilistic predictions or threshold exceedances. - Batch-process large arrays of forecast–observation pairs to generate aggregate performance metrics. ## Worth the install? AI-flagged interpretation of the facts above — verify before relying. Properscoring provides strictly proper scoring rules for evaluating probabilistic forecasts, including Continuous Ranked Probability Score (CRPS) and Brier Score methods that work with ensemble forecasts, Gaussian distributions, and arbitrary cumulative distribution functions. Yes, if you need strictly proper scoring rules for probabilistic forecast evaluation and can tolerate an abandoned package. The core algorithms are scientifically sound and the library has no known vulnerabilities. However, verify compatibility with your Python version before relying on it in production; consider seeking an actively maintained alternative if you need ongoing support or updates. ## Install pip install properscoring uv add properscoring poetry add properscoring ## Installing properscoring Before you install: Installation is straightforward with no runtime dependencies, though the package is abandoned—last release was 2015-11-12 and last commit 2023-03-09. It targets Python 2 and early Python 3 versions; compatibility with modern Python is unverified. License in practice: Licensed under Apache License 2.0 (permissive), allowing commercial and private use with minimal restrictions, though you must include a copy of the license and state any modifications. Quickstart: pip install properscoring import properscoring as ps # Calculate CRPS for a Gaussian forecast ps.crps_gaussian(0, mu=0, sig=1) Requires NumPy (1.8 or later) and SciPy; Numba is optional but highly encouraged for performance on crps_ensemble and threshold_brier_score. Verify before relying: - Whether the package works reliably on Python 3.6 and later versions despite classifiers only listing up to 3.5. - Current performance characteristics and whether Numba speedups (e.g., 20x) still apply with modern versions. - Whether the package's core algorithms remain scientifically current for modern forecast evaluation workflows. ## Package facts - License: Apache (permissive) - Python support: unspecified - Install friction: low - Maintenance: abandoned - Downloads: 167.2K/month (top 15,000 on PyPI) - Known vulnerabilities: none known ## Tags probabilistic forecast evaluation, proper scoring rules, CRPS continuous ranked probability score, brier score calculation, forecast verification metrics, ensemble forecast scoring, weather forecast evaluation, forecast-evaluation, proper-scoring-rules, probabilistic-metrics [View on SkillFed](https://skillfed.io/packages/properscoring) · [View on PyPI](https://pypi.org/project/properscoring/)