Confidence Bands for ROC Curves With Serially Dependent Data

A-Tier
Journal: Journal of Business & Economic Statistics
Year: 2018
Volume: 36
Issue: 1
Pages: 115-130

Authors (2)

Score contribution per author:

2.011 = (α=2.01 / 2 authors) × 2.0x A-tier

α: calibrated so average coauthorship-adjusted count equals average raw count

Abstract

We propose serial correlation-robust asymptotic confidence bands for the receiver operating characteristic (ROC) curve and its functional, viz., the area under ROC curve (AUC), estimated by quasi-maximum likelihood in the binormal model. Our simulation experiments confirm that this new method performs fairly well in finite samples, and confers an additional measure of robustness to nonnormality. The conventional procedure is found to be markedly undersized in terms of yielding empirical coverage probabilities lower than the nominal level, especially when the serial correlation is strong. An example from macroeconomic forecasting demonstrates the importance of accounting for serial correlation when the probability forecasts for real GDP declines are evaluated using ROC. Supplementary materials for this article are available online.

Technical Details

RePEc Handle
repec:taf:jnlbes:v:36:y:2018:i:1:p:115-130
Journal Field
Econometrics
Author Count
2
Added to Database
2026-01-25