Linearized Additive Classifiers

Details Linearized Additive Classifiers Linearized Additive Classifiers

2011-10-05

arxiv.org/abs/1110.0879v1

Computer Science

Computer Vision and Pattern Recognition

Scientific paper

We revisit the additive model learning literature and adapt a penalized spline formulation due to Eilers and Marx, to train additive classifiers efficiently. We also propose two new embeddings based two classes of orthogonal basis with orthogonal derivatives, which can also be used to efficiently learn additive classifiers. This paper follows the popular theme in the current literature where kernel SVMs are learned much more efficiently using a approximate embedding and linear machine. In this paper we show that spline basis are especially well suited for learning additive models because of their sparsity structure and the ease of computing the embedding which enables one to train these models in an online manner, without incurring the memory overhead of precomputing the storing the embeddings. We show interesting connections between B-Spline basis and histogram intersection kernel and show that for a particular choice of regularization and degree of the B-Splines, our proposed learning algorithm closely approximates the histogram intersection kernel SVM. This enables one to learn additive models with almost no memory overhead compared to fast a linear solver, such as LIBLINEAR, while being only 5-6X slower on average. On two large scale image classification datasets, MNIST and Daimler Chrysler pedestrians, the proposed additive classifiers are as accurate as the kernel SVM, while being two orders of magnitude faster to train.

Affiliated with

Also associated with

No associations

Rating

Linearized Additive Classifiers does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Linearized Additive Classifiers, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Linearized Additive Classifiers will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-324547