Classification Constrained Dimensionality Reduction

Details Classification Constrained Dimensionality Reduction Classification Constrained Dimensionality Reduction

2008-02-20

arxiv.org/abs/0802.2906v2

Statistics

Machine Learning

Scientific paper

Dimensionality reduction is a topic of recent interest. In this paper, we present the classification constrained dimensionality reduction (CCDR) algorithm to account for label information. The algorithm can account for multiple classes as well as the semi-supervised setting. We present an out-of-sample expressions for both labeled and unlabeled data. For unlabeled data, we introduce a method of embedding a new point as preprocessing to a classifier. For labeled data, we introduce a method that improves the embedding during the training phase using the out-of-sample extension. We investigate classification performance using the CCDR algorithm on hyper-spectral satellite imagery data. We demonstrate the performance gain for both local and global classifiers and demonstrate a 10% improvement of the $k$-nearest neighbors algorithm performance. We present a connection between intrinsic dimension estimation and the optimal embedding dimension obtained using the CCDR algorithm.

Affiliated with

Also associated with

No associations

Rating

Classification Constrained Dimensionality Reduction does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Classification Constrained Dimensionality Reduction, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Classification Constrained Dimensionality Reduction will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-648105