Oracle Inequalities and Optimal Inference under Group Sparsity

Details Oracle Inequalities and Optimal Inference under Group Sparsity Oracle Inequalities and Optimal Inference under Group Sparsity

2010-07-11

arxiv.org/abs/1007.1771v3

Mathematics

Statistics Theory

37 pages

Scientific paper

We consider the problem of estimating a sparse linear regression vector $\beta^*$ under a gaussian noise model, for the purpose of both prediction and model selection. We assume that prior knowledge is available on the sparsity pattern, namely the set of variables is partitioned into prescribed groups, only few of which are relevant in the estimation process. This group sparsity assumption suggests us to consider the Group Lasso method as a means to estimate $\beta^*$. We establish oracle inequalities for the prediction and $\ell_2$ estimation errors of this estimator. These bounds hold under a restricted eigenvalue condition on the design matrix. Under a stronger coherence condition, we derive bounds for the estimation error for mixed $(2,p)$-norms with $1\le p\leq \infty$. When $p=\infty$, this result implies that a threshold version of the Group Lasso estimator selects the sparsity pattern of $\beta^*$ with high probability. Next, we prove that the rate of convergence of our upper bounds is optimal in a minimax sense, up to a logarithmic factor, for all estimators over a class of group sparse vectors. Furthermore, we establish lower bounds for the prediction and $\ell_2$ estimation errors of the usual Lasso estimator. Using this result, we demonstrate that the Group Lasso can achieve an improvement in the prediction and estimation properties as compared to the Lasso.

Affiliated with

Also associated with

No associations

Rating

Oracle Inequalities and Optimal Inference under Group Sparsity does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Oracle Inequalities and Optimal Inference under Group Sparsity, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Oracle Inequalities and Optimal Inference under Group Sparsity will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-563431