Covariance Estimation: The GLM and Regularization Perspectives

Details Covariance Estimation: The GLM and Regularization Perspectives Covariance Estimation: The GLM and Regularization Perspectives

2012-02-08

arxiv.org/abs/1202.1661v1

Statistical Science 2011, Vol. 26, No. 3, 369-387

Statistics

Methodology

Published in at http://dx.doi.org/10.1214/11-STS358 the Statistical Science (http://www.imstat.org/sts/) by the Institute of M

Scientific paper

10.1214/11-STS358

Finding an unconstrained and statistically interpretable reparameterization of a covariance matrix is still an open problem in statistics. Its solution is of central importance in covariance estimation, particularly in the recent high-dimensional data environment where enforcing the positive-definiteness constraint could be computationally expensive. We provide a survey of the progress made in modeling covariance matrices from two relatively complementary perspectives: (1) generalized linear models (GLM) or parsimony and use of covariates in low dimensions, and (2) regularization or sparsity for high-dimensional data. An emerging, unifying and powerful trend in both perspectives is that of reducing a covariance estimation problem to that of estimating a sequence of regression problems. We point out several instances of the regression-based formulation. A notable case is in sparse estimation of a precision matrix or a Gaussian graphical model leading to the fast graphical LASSO algorithm. Some advantages and limitations of the regression-based Cholesky decomposition relative to the classical spectral (eigenvalue) and variance-correlation decompositions are highlighted. The former provides an unconstrained and statistically interpretable reparameterization, and guarantees the positive-definiteness of the estimated covariance matrix. It reduces the unintuitive task of covariance estimation to that of modeling a sequence of regressions at the cost of imposing an a priori order among the variables. Elementwise regularization of the sample covariance matrix such as banding, tapering and thresholding has desirable asymptotic properties and the sparse estimated covariance matrix is positive definite with probability tending to one for large samples and dimensions.

Affiliated with

Also associated with

No associations

Rating

Covariance Estimation: The GLM and Regularization Perspectives does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Covariance Estimation: The GLM and Regularization Perspectives, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Covariance Estimation: The GLM and Regularization Perspectives will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-64418