Grouped Variable Selection via Nested Spike and Slab Priors

Details Grouped Variable Selection via Nested Spike and Slab Priors Grouped Variable Selection via Nested Spike and Slab Priors

2011-06-29

arxiv.org/abs/1106.5837v1

Statistics

Methodology

47 pages, 7 figures

Scientific paper

In this paper we study grouped variable selection problems by proposing a specified prior, called the nested spike and slab prior, to model collective behavior of regression coefficients. At the group level, the nested spike and slab prior puts positive mass on the event that the l2-norm of the grouped coefficients is equal to zero. At the individual level, each coefficient is assumed to follow a spike and slab prior. We carry out maximum a posteriori estimation for the model by applying blockwise coordinate descent algorithms to solve an optimization problem involving an approximate objective modified by majorization-minimization techniques. Simulation studies show that the proposed estimator performs relatively well in the situations in which the true and redundant covariates are both covered by the same group. Asymptotic analysis under a frequentist's framework further shows that the l2 estimation error of the proposed estimator can have a better upper bound if the group that covers the true covariates does not cover too many redundant covariates. In addition, given some regular conditions hold, the proposed estimator is asymptotically invariant to group structures, and its model selection consistency can be established without imposing irrepresentable-type conditions.

Affiliated with

Also associated with

No associations

Rating

Grouped Variable Selection via Nested Spike and Slab Priors does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Grouped Variable Selection via Nested Spike and Slab Priors, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Grouped Variable Selection via Nested Spike and Slab Priors will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-358794