Learning sparse gradients for variable selection and dimension reduction

Details Learning sparse gradients for variable selection and dimension reduction Learning sparse gradients for variable selection and dimension reduction

2010-06-25

arxiv.org/abs/1006.5060v2

Statistics

Machine Learning

Scientific paper

Variable selection and dimension reduction are two commonly adopted approaches for high-dimensional data analysis, but have traditionally been treated separately. Here we propose an integrated approach, called sparse gradient learning (SGL), for variable selection and dimension reduction via learning the gradients of the prediction function directly from samples. By imposing a sparsity constraint on the gradients, variable selection is achieved by selecting variables corresponding to non-zero partial derivatives, and effective dimensions are extracted based on the eigenvectors of the derived sparse empirical gradient covariance matrix. An error analysis is given for the convergence of the estimated gradients to the true ones in both the Euclidean and the manifold setting. We also develop an efficient forward-backward splitting algorithm to solve the SGL problem, making the framework practically scalable for medium or large datasets. The utility of SGL for variable selection and feature extraction is explicitly given and illustrated on artificial data as well as real-world examples. The main advantages of our method include variable selection for both linear and nonlinear predictions, effective dimension reduction with sparse loadings, and an efficient algorithm for large p, small n problems.

Affiliated with

Also associated with

No associations

Rating

Learning sparse gradients for variable selection and dimension reduction does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Learning sparse gradients for variable selection and dimension reduction, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Learning sparse gradients for variable selection and dimension reduction will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-525342