On the Distribution of Penalized Maximum Likelihood Estimators: The LASSO, SCAD, and Thresholding

Details On the Distribution of Penalized Maximum Likelihood Estimators: The LASSO, SCAD, and Thresholding On the Distribution of Penalized Maximum Likelihood Estimators: The LASSO, SCAD, and Thresholding

2007-11-05

arxiv.org/abs/0711.0660v2

J. Multivariate Anal. 100 (2009) 2065-2082

Mathematics

Statistics Theory

Scientific paper

10.1016/j.jmva.2009.06.010

We study the distributions of the LASSO, SCAD, and thresholding estimators, in finite samples and in the large-sample limit. The asymptotic distributions are derived for both the case where the estimators are tuned to perform consistent model selection and for the case where the estimators are tuned to perform conservative model selection. Our findings complement those of Knight and Fu (2000) and Fan and Li (2001). We show that the distributions are typically highly nonnormal regardless of how the estimator is tuned, and that this property persists in large samples. The uniform convergence rate of these estimators is also obtained, and is shown to be slower than 1/root(n) in case the estimator is tuned to perform consistent model selection. An impossibility result regarding estimation of the estimators' distribution function is also provided.

Affiliated with

Also associated with

No associations

Rating

On the Distribution of Penalized Maximum Likelihood Estimators: The LASSO, SCAD, and Thresholding does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with On the Distribution of Penalized Maximum Likelihood Estimators: The LASSO, SCAD, and Thresholding, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and On the Distribution of Penalized Maximum Likelihood Estimators: The LASSO, SCAD, and Thresholding will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-660108