How redefining statistical significance can worsen the replication crisis

C-Tier
Journal: Economics Letters
Year: 2019
Volume: 181
Issue: C
Pages: 65-69

Score contribution per author:

1.005 = (α=2.01 / 1 authors) × 0.5x C-tier

α: calibrated so average coauthorship-adjusted count equals average raw count

Abstract

In response to the replication crisis in science, a group of prominent scholars has proposed redefining statistical significance by reducing the p-value significance threshold from 0.05 to 0.005. Rather than solving the replication problem, I show that lowering the significance threshold can increase the rate of false positives by creating a negative selection effect. Thus, redefining statistical significance may not be a silver bullet for solving the replication crisis.

Technical Details

RePEc Handle
repec:eee:ecolet:v:181:y:2019:i:c:p:65-69
Journal Field
General
Author Count
1
Added to Database
2026-01-29