Statistics and Its Interface

Volume 9 (2016)

Number 4

Special Issue on Statistical and Computational Theory and Methodology for Big Data

Guest Editors: Ming-Hui Chen (University of Connecticut); Radu V. Craiu (University of Toronto); Faming Liang (University of Florida); and Chuanhai Liu (Purdue University)

High-dimensional covariance estimation under the presence of outliers

Pages: 461 – 468

DOI: https://dx.doi.org/10.4310/SII.2016.v9.n4.a6

Authors

Hsin-Cheng Huang (Institute of Statistical Science, Academia Sinica, Taipei, Taiwan)

Thomas C. M. Lee (Department of Statistics, University of California at Davis)

Abstract

This paper considers the problem of robust covariance estimation in the so-called “large $p$ small $n$” setting. Its first contribution is the proposal of a novel (non-robust) high-dimensional covariance estimation method that is based on eigenvalue regularization. The method is called Cover, short for COVariance Eigenvalue-Regularized estimation. It is fast to execute and enjoys excellent theoretical properties for the case when $p$ is fixed. As a second contribution, this paper modifies Cover by incorporating Huber’s loss function into the estimation procedure. By design, the resulting method is robust to outliers and is called RCover. The empirical performances of Cover and RCover are tested and compared with existing methods via a sequence of numerical experiments. It is shown that, with the presence of outliers, RCover almost always outperforms other methods tested.

Keywords

difference convex programming, Eigenvalue regularization, ES-algorithm, Huber function

Full Text (PDF format)

Published 14 September 2016