Boosting k-NN for categorization of natural scenes

Details Boosting k-NN for categorization of natural scenes Boosting k-NN for categorization of natural scenes

2010-01-08

arxiv.org/abs/1001.1221v1

Computer Science

Computer Vision and Pattern Recognition

under revision for IJCV

Scientific paper

The k-nearest neighbors (k-NN) classification rule has proven extremely successful in countless many computer vision applications. For example, image categorization often relies on uniform voting among the nearest prototypes in the space of descriptors. In spite of its good properties, the classic k-NN rule suffers from high variance when dealing with sparse prototype datasets in high dimensions. A few techniques have been proposed to improve k-NN classification, which rely on either deforming the nearest neighborhood relationship or modifying the input space. In this paper, we propose a novel boosting algorithm, called UNN (Universal Nearest Neighbors), which induces leveraged k-NN, thus generalizing the classic k-NN rule. We redefine the voting rule as a strong classifier that linearly combines predictions from the k closest prototypes. Weak classifiers are learned by UNN so as to minimize a surrogate risk. A major feature of UNN is the ability to learn which prototypes are the most relevant for a given class, thus allowing one for effective data reduction. Experimental results on the synthetic two-class dataset of Ripley show that such a filtering strategy is able to reject "noisy" prototypes. We carried out image categorization experiments on a database containing eight classes of natural scenes. We show that our method outperforms significantly the classic k-NN classification, while enabling significant reduction of the computational cost by means of data filtering.

Affiliated with

Also associated with

No associations

Rating

Boosting k-NN for categorization of natural scenes does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Boosting k-NN for categorization of natural scenes, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Boosting k-NN for categorization of natural scenes will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-502060