Computer Science – Learning
Scientific paper
2010-12-04
Computer Science
Learning
29 pages
Scientific paper
In practical applications, machine learning algorithms are often needed to learn classifiers that optimize domain specific performance measures. In the past, the research has focused on learning the needed classifier in isolation, yet learning nonlinear classifier for nonlinear and nonsmooth performance measures is still hard. In this paper, rather than learning the needed classifier by optimizing the concerned performance measure directly, we propose a new framework EL-perf to circumvent this problem. In EL-perf, we first train auxiliary classifiers by optimizing an easy-to-handle performance measure; and then adapt these auxiliary classifiers to optimize the concerned performance measure. Under the function-level adaptation framework, the classifier adaptation problem of EL-perf is formulated as a quadratic programming problem, which is similar to linear SVM-perf and can be efficiently solved. Practically, by using nonlinear auxiliary classifiers, EL-perf can generate nonlinear classifier that optimizes required performance measure, whilst keeping computational efficiency. In extensive empirical studies, we show that training auxiliary classifiers using accuracy is sufficiently good for EL-perf, and other performance measure is not necessary. As well, it is shown that EL-perf is effective and efficient in training classifiers that optimize performance measures, and even its classifier adaptation procedure is more efficient than linear SVM-perf.
Li Nan
Tsang Ivor W.
Zhou Zhi-Hua
No associations
LandOfFree
Efficiently Learning Nonlinear Classifiers for Domain Specific Performance Measures does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Efficiently Learning Nonlinear Classifiers for Domain Specific Performance Measures, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Efficiently Learning Nonlinear Classifiers for Domain Specific Performance Measures will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-99667