Measuring and Bounding Experimenter Demand

S-Tier
Journal: American Economic Review
Year: 2018
Volume: 108
Issue: 11
Pages: 3266-3302

Score contribution per author:

2.681 = (α=2.01 / 3 authors) × 4.0x S-tier

α: calibrated so average coauthorship-adjusted count equals average raw count

Abstract

We propose a technique for assessing robustness to demand effects of findings from experiments and surveys. The core idea is that by deliberately inducing demand in a structured way we can bound its influence. We present a model in which participants respond to their beliefs about the researcher's objectives. Bounds are obtained by manipulating those beliefs with "demand treatments." We apply the method to 11 classic tasks, and estimate bounds averaging 0.13 standard deviations, suggesting that typical demand effects are probably modest. We also show how to compute demand-robust treatment effects and how to structurally estimate the model.

Technical Details

RePEc Handle
repec:aea:aecrev:v:108:y:2018:i:11:p:3266-3302
Journal Field
General
Author Count
3
Added to Database
2026-01-25