Operator norm consistent estimation of large-dimensional sparse covariance matrices

Details Operator norm consistent estimation of large-dimensional sparse covariance matrices Operator norm consistent estimation of large-dimensional sparse covariance matrices

2009-01-21

arxiv.org/abs/0901.3220v1

Annals of Statistics 2008, Vol. 36, No. 6, 2717-2756

Mathematics

Statistics Theory

Published in at http://dx.doi.org/10.1214/07-AOS559 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of

Scientific paper

10.1214/07-AOS559

Estimating covariance matrices is a problem of fundamental importance in multivariate statistics. In practice it is increasingly frequent to work with data matrices $X$ of dimension $n\times p$, where $p$ and $n$ are both large. Results from random matrix theory show very clearly that in this setting, standard estimators like the sample covariance matrix perform in general very poorly. In this "large $n$, large $p$" setting, it is sometimes the case that practitioners are willing to assume that many elements of the population covariance matrix are equal to 0, and hence this matrix is sparse. We develop an estimator to handle this situation. The estimator is shown to be consistent in operator norm, when, for instance, we have $p\asymp n$ as $n\to\infty$. In other words the largest singular value of the difference between the estimator and the population covariance matrix goes to zero. This implies consistency of all the eigenvalues and consistency of eigenspaces associated to isolated eigenvalues. We also propose a notion of sparsity for matrices, that is, "compatible" with spectral analysis and is independent of the ordering of the variables.

Affiliated with

Also associated with

No associations

Rating

Operator norm consistent estimation of large-dimensional sparse covariance matrices does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Operator norm consistent estimation of large-dimensional sparse covariance matrices, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Operator norm consistent estimation of large-dimensional sparse covariance matrices will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-684321