Exploring Large Feature Spaces with Hierarchical Multiple Kernel Learning

Details Exploring Large Feature Spaces with Hierarchical Multiple Kernel Learning Exploring Large Feature Spaces with Hierarchical Multiple Kernel Learning

2008-09-09

arxiv.org/abs/0809.1493v1

Computer Science

Learning

Scientific paper

For supervised and unsupervised learning, positive definite kernels allow to use large and potentially infinite dimensional feature spaces with a computational cost that only depends on the number of observations. This is usually done through the penalization of predictor functions by Euclidean or Hilbertian norms. In this paper, we explore penalizing by sparsity-inducing norms such as the l1-norm or the block l1-norm. We assume that the kernel decomposes into a large sum of individual basis kernels which can be embedded in a directed acyclic graph; we show that it is then possible to perform kernel selection through a hierarchical multiple kernel learning framework, in polynomial time in the number of selected kernels. This framework is naturally applied to non linear variable selection; our extensive simulations on synthetic datasets and datasets from the UCI repository show that efficiently exploring the large feature space through sparsity-inducing norms leads to state-of-the-art predictive performance.

Affiliated with

Also associated with

No associations

Rating

Exploring Large Feature Spaces with Hierarchical Multiple Kernel Learning does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Exploring Large Feature Spaces with Hierarchical Multiple Kernel Learning, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Exploring Large Feature Spaces with Hierarchical Multiple Kernel Learning will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-210406