A multivariate adaptive stochastic search method for dimensionality reduction in classification

Details A multivariate adaptive stochastic search method for dimensionality reduction in classification A multivariate adaptive stochastic search method for dimensionality reduction in classification

2010-10-07

arxiv.org/abs/1010.1406v1

Annals of Applied Statistics 2010, Vol. 4, No. 1, 340-365

Statistics

Applications

Published in at http://dx.doi.org/10.1214/09-AOAS284 the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Ins

Scientific paper

10.1214/09-AOAS284

High-dimensional classification has become an increasingly important problem. In this paper we propose a "Multivariate Adaptive Stochastic Search" (MASS) approach which first reduces the dimension of the data space and then applies a standard classification method to the reduced space. One key advantage of MASS is that it automatically adjusts to mimic variable selection type methods, such as the Lasso, variable combination methods, such as PCA, or methods that combine these two approaches. The adaptivity of MASS allows it to perform well in situations where pure variable selection or variable combination methods fail. Another major advantage of our approach is that MASS can accurately project the data into very low-dimensional non-linear, as well as linear, spaces. MASS uses a stochastic search algorithm to select a handful of optimal projection directions from a large number of random directions in each iteration. We provide some theoretical justification for MASS and demonstrate its strengths on an extensive range of simulation studies and real world data sets by comparing it to many classical and modern classification methods.

Affiliated with

Also associated with

No associations

Rating

A multivariate adaptive stochastic search method for dimensionality reduction in classification does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with A multivariate adaptive stochastic search method for dimensionality reduction in classification, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and A multivariate adaptive stochastic search method for dimensionality reduction in classification will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-509549