Structured Variable Selection with Sparsity-Inducing Norms

Details Structured Variable Selection with Sparsity-Inducing Norms Structured Variable Selection with Sparsity-Inducing Norms

2009-04-22

arxiv.org/abs/0904.3523v3

Journal of Machine Learning Research 12 (2011) 2777-2824

Statistics

Machine Learning

Scientific paper

We consider the empirical risk minimization problem for linear supervised learning, with regularization by structured sparsity-inducing norms. These are defined as sums of Euclidean norms on certain subsets of variables, extending the usual $\ell_1$-norm and the group $\ell_1$-norm by allowing the subsets to overlap. This leads to a specific set of allowed nonzero patterns for the solutions of such problems. We first explore the relationship between the groups defining the norm and the resulting nonzero patterns, providing both forward and backward algorithms to go back and forth from groups to patterns. This allows the design of norms adapted to specific prior knowledge expressed in terms of nonzero patterns. We also present an efficient active set algorithm, and analyze the consistency of variable selection for least-squares linear regression in low and high-dimensional settings.

Affiliated with

Also associated with

No associations

Rating

Structured Variable Selection with Sparsity-Inducing Norms does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Structured Variable Selection with Sparsity-Inducing Norms, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Structured Variable Selection with Sparsity-Inducing Norms will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-275547