Statistics – Methodology
Scientific paper
2010-05-03
Statistics
Methodology
corrected typos
Scientific paper
We propose a new and computationally efficient algorithm for maximizing the observed log-likelihood for a multivariate normal data matrix with missing values. We show that our procedure based on iteratively regressing the missing on the observed variables, generalizes the traditional EM algorithm by alternating between different complete data spaces and performing the E-Step incrementally. In this non-standard setup we prove numerical convergence to a stationary point of the observed log-likelihood. For high-dimensional data, where the number of variables may greatly exceed sample size, we add a Lasso penalty in the regression part of our algorithm and perform coordinate descent approximations. This leads to a computationally very attractive technique with sparse regression coefficients for missing data imputation. Simulations and results on four microarray datasets show that the new method often outperforms alternative imputation techniques as k-nearest neighbors imputation, nuclear norm minimization or a penalized likelihood approach with an L1-penalty on the inverse covariance matrix.
Buehlmann Peter
Staedler Nicolas
No associations
LandOfFree
Pattern Alternating Maximization Algorithm for High-Dimensional Missing Data does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Pattern Alternating Maximization Algorithm for High-Dimensional Missing Data, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Pattern Alternating Maximization Algorithm for High-Dimensional Missing Data will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-659114