Measuring Housing Vitality from Multi-Source Big Data and Machine Learning

B-Tier
Journal: Journal of the American Statistical Association
Year: 2022
Volume: 117
Issue: 539
Pages: 1045-1059

Authors (5)

Yang Zhou (not in RePEc) Lirong Xue (not in RePEc) Zhengyu Shi (not in RePEc) Libo Wu (not in RePEc) Jianqing Fan (Princeton University)

Score contribution per author:

0.402 = (α=2.01 / 5 authors) × 1.0x B-tier

α: calibrated so average coauthorship-adjusted count equals average raw count

Abstract

Measuring timely high-resolution socioeconomic outcomes is critical for policymaking and evaluation, but hard to reliably obtain. With the help of machine learning and cheaply available data such as social media and nightlight, it is now possible to predict such indices in fine granularity. This article demonstrates an adaptive way to measure the time trend and spatial distribution of housing vitality (number of occupied houses) with the help of multiple easily accessible datasets: energy, nightlight, and land-use data. We first identified the high-frequency housing occupancy status from energy consumption data and then matched it with the monthly nightlight data. We then introduced the Factor-Augmented Regularized Model for prediction (FarmPredict) to deal with the dependence and collinearity issue among predictors by effectively lifting the prediction space, which is suitable to most machine learning algorithms. The heterogeneity issue in big data analysis is mitigated through the land-use data. FarmPredict allows us to extend the regional results to the city level, with a 76% out-of-sample explanation of the spatial and timeliness variation in the house usage. Since energy is indispensable for life, our method is highly transferable with the only requirement of publicly accessible data. Our article provides an alternative approach with statistical machine learning to predict socioeconomic outcomes without the reliance on existing census and survey data. Supplementary materials for this article are available online.

Technical Details

RePEc Handle
repec:taf:jnlasa:v:117:y:2022:i:539:p:1045-1059
Journal Field
Econometrics
Author Count
5
Added to Database
2026-01-25