On the Use of Holdout Samples for Model Selection

S-Tier
Journal: American Economic Review
Year: 2012
Volume: 102
Issue: 3
Pages: 477-81

Authors (2)

Frank Schorfheide (University of Pennsylvania) Kenneth I. Wolpin (not in RePEc)

Score contribution per author:

4.022 = (α=2.01 / 2 authors) × 4.0x S-tier

α: calibrated so average coauthorship-adjusted count equals average raw count

Abstract

Researchers often hold out data from the estimation of econometric models to use for external validation. However, the use of holdout samples is suboptimal from a Bayesian perspective, which prescribes using the entire sample to form posterior model weights. This paper examines a possible rationale for the use of holdout samples: data-inspired modifications of structural models are likely to lead to an exaggeration of model fit. The use of holdout samples can, in principle, set an incentive for the modeler not to exaggerate model fit.

Technical Details

RePEc Handle
repec:aea:aecrev:v:102:y:2012:i:3:p:477-81
Journal Field
General
Author Count
2
Added to Database
2026-01-29