Statistics and Its Interface

Volume 7 (2014)

Number 4

Special Issue on Modern Bayesian Statistics (Part I)

Guest Editor: Ming-Hui Chen (University of Connecticut)

Bayesian case-deletion model complexity and information criterion

Pages: 531 – 542

DOI: https://dx.doi.org/10.4310/SII.2014.v7.n4.a9

Authors

Hongtu Zhu (Department of Biostatistics, University of North Carolina at Chapel Hill, U.S.A.)

Joseph G. Ibrahim (Department of Biostatistics, University of North Carolina at Chapel Hill, U.S.A.)

Qingxia Chen (Department of Biostatistics, Vanderbilt University, Nashville, Tennessee, U.S.A.)

Abstract

We establish a connection between Bayesian case influence measures for assessing the influence of individual observations and Bayesian predictive methods for evaluating the predictive performance of a model and comparing different models fit to the same dataset. Based on such a connection, we formally propose a new set of Bayesian case-deletion model complexity (BCMC) measures for quantifying the effective number of parameters in a given statistical model and its properties in linear models are explored. Adding certain functions of BCMC to a conditional deviance function leads to a Bayesian case-deletion information criterion (BCIC) for comparing models. We systematically investigate some properties of BCIC and its connections with other information criteria, such as the Deviance Information Criterion (DIC). We illustrate the proposed methodology for the linear mixed model with simulations and a real data example.

Keywords

Bayesian, case influence measures, cross validation, information criterion, Markov chain Monte Carlo, model complexity

Published 23 December 2014