Spike and slab variable selection: Frequentist and Bayesian strategies

Details Spike and slab variable selection: Frequentist and Bayesian strategies Spike and slab variable selection: Frequentist and Bayesian strategies

2005-05-30

arxiv.org/abs/math/0505633v1

Annals of Statistics 2005, Vol. 33, No. 2, 730-773

Mathematics

Statistics Theory

Published at http://dx.doi.org/10.1214/009053604000001147 in the Annals of Statistics (http://www.imstat.org/aos/) by the Inst

Scientific paper

10.1214/009053604000001147

Variable selection in the linear regression model takes many apparent faces from both frequentist and Bayesian standpoints. In this paper we introduce a variable selection method referred to as a rescaled spike and slab model. We study the importance of prior hierarchical specifications and draw connections to frequentist generalized ridge regression estimation. Specifically, we study the usefulness of continuous bimodal priors to model hypervariance parameters, and the effect scaling has on the posterior mean through its relationship to penalization. Several model selection strategies, some frequentist and some Bayesian in nature, are developed and studied theoretically. We demonstrate the importance of selective shrinkage for effective variable selection in terms of risk misclassification, and show this is achieved using the posterior from a rescaled spike and slab model. We also show how to verify a procedure's ability to reduce model uncertainty in finite samples using a specialized forward selection strategy. Using this tool, we illustrate the effectiveness of rescaled spike and slab models in reducing model uncertainty.

Affiliated with

Also associated with

No associations

Rating

Spike and slab variable selection: Frequentist and Bayesian strategies does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Spike and slab variable selection: Frequentist and Bayesian strategies, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Spike and slab variable selection: Frequentist and Bayesian strategies will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-314906