Proper Scoring Rules for Evaluating Density Forecasts with Asymmetric Loss Functions

A-Tier
Journal: Journal of Business & Economic Statistics
Year: 2023
Volume: 41
Issue: 2
Pages: 482-496

Authors (3)

Matteo Iacopini (not in RePEc) Francesco Ravazzolo (not in RePEc) Luca Rossini (Università Ca' Foscari Venezia)

Score contribution per author:

1.341 = (α=2.01 / 3 authors) × 2.0x A-tier

α: calibrated so average coauthorship-adjusted count equals average raw count

Abstract

This article proposes a novel asymmetric continuous probabilistic score (ACPS) for evaluating and comparing density forecasts. It generalizes the proposed score and defines a weighted version, which emphasizes regions of interest, such as the tails or the center of a variable’s range. The (weighted) ACPS extends the symmetric (weighted) CRPS by allowing for asymmetries in the preferences underlying the scoring rule. A test is used to statistically compare the predictive ability of different forecasts. The ACPS is of general use in any situation where the decision-maker has asymmetric preferences in the evaluation of the forecasts. In an artificial experiment, the implications of varying the level of asymmetry in the ACPS are illustrated. Then, the proposed score and test are applied to assess and compare density forecasts of macroeconomic relevant datasets (U.S. employment growth) and of commodity prices (oil and electricity prices) with particular focus on the recent COVID-19 crisis period.

Technical Details

RePEc Handle
repec:taf:jnlbes:v:41:y:2023:i:2:p:482-496
Journal Field
Econometrics
Author Count
3
Added to Database
2026-01-29