Boosting through Optimization of Margin Distributions

Details Boosting through Optimization of Margin Distributions Boosting through Optimization of Margin Distributions

2009-04-14

arxiv.org/abs/0904.2037v3

Computer Science

Learning

9 pages. To publish/Published in IEEE Transactions on Neural Networks, 21(7), July 2010

Scientific paper

Boosting has attracted much research attention in the past decade. The success of boosting algorithms may be interpreted in terms of the margin theory. Recently it has been shown that generalization error of classifiers can be obtained by explicitly taking the margin distribution of the training data into account. Most of the current boosting algorithms in practice usually optimizes a convex loss function and do not make use of the margin distribution. In this work we design a new boosting algorithm, termed margin-distribution boosting (MDBoost), which directly maximizes the average margin and minimizes the margin variance simultaneously. This way the margin distribution is optimized. A totally-corrective optimization algorithm based on column generation is proposed to implement MDBoost. Experiments on UCI datasets show that MDBoost outperforms AdaBoost and LPBoost in most cases.

Affiliated with

Also associated with

No associations

Rating

Boosting through Optimization of Margin Distributions does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Boosting through Optimization of Margin Distributions, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Boosting through Optimization of Margin Distributions will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-98220