Multibenchmark reality checks

C-Tier
Journal: Economic Modeling
Year: 2024
Volume: 140
Issue: C

Score contribution per author:

0.503 = (α=2.01 / 2 authors) × 0.5x C-tier

α: calibrated so average coauthorship-adjusted count equals average raw count

Abstract

Empirical economic modelers often have to choose between two classes of models, with each class containing multiple models. In many cases, this decision is based on the predictive ability of the considered models. This entails that multiple testing and/or p-hacking pose known risks. This study presents a new statistical approach for comparing all model in a single test, serving as a multi-benchmark reality check test. The behavior of the test is studied asymptotically and in small finite samples. We show how the new approach works by analyzing whether one family of linear bivariate models outperforms a univariate family in predicting commodity prices. This paper raises new questions for future research. From an empirical viewpoint, we present several open questions in economic modeling that can be tested with multi-benchmark tests. Meanwhile, from a theoretical viewpoint, further studies can investigate whether a more general method for approximating or simulating the test distribution can be developed.

Technical Details

RePEc Handle
repec:eee:ecmode:v:140:y:2024:i:c:s0264999324002050
Journal Field
General
Author Count
2
Added to Database
2026-01-24