Trace Lasso: a trace norm regularization for correlated designs

Details Trace Lasso: a trace norm regularization for correlated designs Trace Lasso: a trace norm regularization for correlated designs

2011-09-09

arxiv.org/abs/1109.1990v1

Neural Information Processing Systems, Spain (2012)

Computer Science

Learning

Scientific paper

Using the $\ell_1$-norm to regularize the estimation of the parameter vector of a linear model leads to an unstable estimator when covariates are highly correlated. In this paper, we introduce a new penalty function which takes into account the correlation of the design matrix to stabilize the estimation. This norm, called the trace Lasso, uses the trace norm, which is a convex surrogate of the rank, of the selected covariates as the criterion of model complexity. We analyze the properties of our norm, describe an optimization algorithm based on reweighted least-squares, and illustrate the behavior of this norm on synthetic data, showing that it is more adapted to strong correlations than competing methods such as the elastic net.

Affiliated with

Also associated with

No associations

Rating

Trace Lasso: a trace norm regularization for correlated designs does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Trace Lasso: a trace norm regularization for correlated designs, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Trace Lasso: a trace norm regularization for correlated designs will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-413556