Positive Semidefinite Metric Learning Using Boosting-like Algorithms

Details Positive Semidefinite Metric Learning Using Boosting-like Algorithms Positive Semidefinite Metric Learning Using Boosting-like Algorithms

2011-04-25

arxiv.org/abs/1104.4704v2

Computer Science

Computer Vision and Pattern Recognition

30 pages, appearing in Journal of Machine Learning Research

Scientific paper

The success of many machine learning and pattern recognition methods relies heavily upon the identification of an appropriate distance metric on the input data. It is often beneficial to learn such a metric from the input training data, instead of using a default one such as the Euclidean distance. In this work, we propose a boosting-based technique, termed BoostMetric, for learning a quadratic Mahalanobis distance metric. Learning a valid Mahalanobis distance metric requires enforcing the constraint that the matrix parameter to the metric remains positive definite. Semidefinite programming is often used to enforce this constraint, but does not scale well and easy to implement. BoostMetric is instead based on the observation that any positive semidefinite matrix can be decomposed into a linear combination of trace-one rank-one matrices. BoostMetric thus uses rank-one positive semidefinite matrices as weak learners within an efficient and scalable boosting-based learning process. The resulting methods are easy to implement, efficient, and can accommodate various types of constraints. We extend traditional boosting algorithms in that its weak learner is a positive semidefinite matrix with trace and rank being one rather than a classifier or regressor. Experiments on various datasets demonstrate that the proposed algorithms compare favorably to those state-of-the-art methods in terms of classification accuracy and running time.

Affiliated with

Also associated with

No associations

Rating

Positive Semidefinite Metric Learning Using Boosting-like Algorithms does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Positive Semidefinite Metric Learning Using Boosting-like Algorithms, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Positive Semidefinite Metric Learning Using Boosting-like Algorithms will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-544811