Statistics and Its Interface

Volume 12 (2019)

Number 2

Bayesian high-dimensional regression for change point analysis

Pages: 253 – 264

DOI: https://dx.doi.org/10.4310/SII.2019.v12.n2.a6

Authors

Abhirup Datta (Department of Biostatistics, Johns Hopkins University, Baltimore, Maryland, U.S.A.)

Hui Zou (Department of Statistics, University of Minnesota, Minneapolis, Mn., U.S.A.)

Sudipto Banerjee (Department of Biostatistics, University of California at Los Angeles)

Abstract

In many econometrics applications, the dataset under investigation spans heterogeneous regimes that are more appropriately modeled using piece-wise components for each of the data segments separated by change-points. We consider using Bayesian high-dimensional shrinkage priors in a change point setting to understand segment-specific relationship between the response and the covariates. Covariate selection before and after each change point can identify possibly different sets of relevant covariates, while the fully Bayesian approach ensures posterior inference for the change points is also available. We demonstrate the flexibility of the approach for imposing different variable selection constraints like grouping or partial selection and discuss strategies to detect an unknown number of change points. Simulation experiments reveal that this simple approach delivers accurate variable selection, and inference on location of the change points, and substantially outperforms a frequentist lasso-based approach, uniformly across a wide range of scenarios. Application of our model to Minnesota house price dataset reveals change in the relationship between house and stock prices around the sub-prime mortgage crisis.

Keywords

Bayesian inference, change point detection, high-dimensional regression, Markov Chain Monte Carlo, Minnesota house price data, variable selection

Received 15 March 2018

Published 11 March 2019