Improved variable selection with Forward-Lasso adaptive shrinkage

Details Improved variable selection with Forward-Lasso adaptive shrinkage Improved variable selection with Forward-Lasso adaptive shrinkage

2011-04-18

arxiv.org/abs/1104.3390v1

Annals of Applied Statistics 2011, Vol. 5, No. 1, 427-448

Statistics

Applications

Published in at http://dx.doi.org/10.1214/10-AOAS375 the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Ins

Scientific paper

10.1214/10-AOAS375

Recently, considerable interest has focused on variable selection methods in regression situations where the number of predictors, $p$, is large relative to the number of observations, $n$. Two commonly applied variable selection approaches are the Lasso, which computes highly shrunk regression coefficients, and Forward Selection, which uses no shrinkage. We propose a new approach, "Forward-Lasso Adaptive SHrinkage" (FLASH), which includes the Lasso and Forward Selection as special cases, and can be used in both the linear regression and the Generalized Linear Model domains. As with the Lasso and Forward Selection, FLASH iteratively adds one variable to the model in a hierarchical fashion but, unlike these methods, at each step adjusts the level of shrinkage so as to optimize the selection of the next variable. We first present FLASH in the linear regression setting and show that it can be fitted using a variant of the computationally efficient LARS algorithm. Then, we extend FLASH to the GLM domain and demonstrate, through numerous simulations and real world data sets, as well as some theoretical analysis, that FLASH generally outperforms many competing approaches.

Affiliated with

Also associated with

No associations

Rating

Improved variable selection with Forward-Lasso adaptive shrinkage does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Improved variable selection with Forward-Lasso adaptive shrinkage, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Improved variable selection with Forward-Lasso adaptive shrinkage will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-71480