Computer Science – Learning
Scientific paper
2010-09-24
Computer Science
Learning
19 pages, 5 figures
Scientific paper
Sparse learning has recently received increasing attention in many areas including machine learning, statistics, and applied mathematics. The mixed-norm regularization based on the L1/Lq norm with q > 1 is attractive in many applications of regression and classification in that it facilitates group sparsity in the model. The resulting optimization problem is, however, challenging to solve due to the structure of the L1/Lq -regularization. Existing work deals with special cases including q = 2,infinity, and they cannot be easily extended to the general case. In this paper, we propose an efficient algorithm based on the accelerated gradient method for solving the L1/Lq -regularized problem, which is applicable for all values of q larger than 1, thus significantly extending existing work. One key building block of the proposed algorithm is the L1/Lq -regularized Euclidean projection (EP1q). Our theoretical analysis reveals the key properties of EP1q and illustrates why EP1q for the general q is significantly more challenging to solve than the special cases. Based on our theoretical analysis, we develop an efficient algorithm for EP1q by solving two zero finding problems. Experimental results demonstrate the efficiency of the proposed algorithm.
Liu Jun
Ye Jieping
No associations
LandOfFree
Efficient L1/Lq Norm Regularization does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Efficient L1/Lq Norm Regularization, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Efficient L1/Lq Norm Regularization will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-273990