Researchers' degrees of flexibility: Revisiting COVID‐19 policy evaluations

C-Tier
Journal: Economic Inquiry
Year: 2025
Volume: 63
Issue: 2
Pages: 441-462

Authors (4)

Joakim A. Weill (not in RePEc) Matthieu Stigler (not in RePEc) Olivier Deschenes (University of California-Santa...) Michael R. Springborn (not in RePEc)

Score contribution per author:

0.252 = (α=2.02 / 4 authors) × 0.5x C-tier

α: calibrated so average coauthorship-adjusted count equals average raw count

Abstract

Empirical research involves multiple, seemingly‐minor choices that can substantially impact a study's findings. While acknowledged, the importance of these “degrees of flexibility” on published estimates is not well understood. We examine the considerable literature focused on the impacts of early COVID‐19 policies on social distancing to assess the role of researchers' degrees of flexibility on the estimated effects of mobility‐reducing policies. We find that estimates reported in previous studies are not robust to minor changes in typically‐unexplored dimensions of the degree of flexibility space, and usual robustness tests systematically fail to detect these issues.

Technical Details

RePEc Handle
repec:bla:ecinqu:v:63:y:2025:i:2:p:441-462
Journal Field
General
Author Count
4
Added to Database
2026-01-25