A self-reference problem in test score normalization

B-Tier
Journal: Economics of Education Review
Year: 2017
Volume: 61
Issue: C
Pages: 79-84

Score contribution per author:

2.011 = (α=2.01 / 1 authors) × 1.0x B-tier

α: calibrated so average coauthorship-adjusted count equals average raw count

Abstract

It is considered standard practice to transform IRT-scaled test scores into standard normal variables for regression analysis in order to enable comparison with other research whose test scores are similarly transformed. This paper calls this practice into question. I show that these transformations can potentially result in radically different estimates of regression parameters due to differences in sample composition. Regression coefficient comparisons between different samples that use z-standardized test scores is only possible if the samples are considered to be random draws from the same population. I outline several different methods to deal with this problem and the caveats attached to each.

Technical Details

RePEc Handle
repec:eee:ecoedu:v:61:y:2017:i:c:p:79-84
Journal Field
Education
Author Count
1
Added to Database
2026-01-29