Using a satisficing model of experimenter decision-making to guide finite-sample inference for compromised experiments

B-Tier
Journal: The Econometrics Journal
Year: 2021
Volume: 24
Issue: 2
Pages: C1-C39

Authors (2)

James J Heckman (University of Chicago) Ganesh Karapakula (not in RePEc)

Score contribution per author:

1.005 = (α=2.01 / 2 authors) × 1.0x B-tier

α: calibrated so average coauthorship-adjusted count equals average raw count

Abstract

SummaryThis paper presents a simple decision-theoretic economic approach for analysing social experiments with compromised random assignment protocols that are only partially documented. We model administratively constrained experimenters who satisfice in seeking covariate balance. We develop design-based small-sample hypothesis tests that use worst-case (least favourable) randomization null distributions. Our approach accommodates a variety of compromised experiments, including imperfectly documented rerandomization designs. To make our analysis concrete, we focus much of our discussion on the influential Perry Preschool Project. We reexamine previous estimates of programme effectiveness using our methods. The choice of how to model reassignment vitally affects inference.

Technical Details

RePEc Handle
repec:oup:emjrnl:v:24:y:2021:i:2:p:c1-c39.
Journal Field
Econometrics
Author Count
2
Added to Database
2026-02-02