Computer Science – Learning
Scientific paper
2011-05-27
In the Fourteenth International Conference on Artificial Intelligence and Statistics April 11-13, 2011 Ft. Lauderdale, FL, USA
Computer Science
Learning
Scientific paper
We propose a nonparametric generalization of belief propagation, Kernel Belief Propagation (KBP), for pairwise Markov random fields. Messages are represented as functions in a reproducing kernel Hilbert space (RKHS), and message updates are simple linear operations in the RKHS. KBP makes none of the assumptions commonly required in classical BP algorithms: the variables need not arise from a finite domain or a Gaussian distribution, nor must their relations take any particular parametric form. Rather, the relations between variables are represented implicitly, and are learned nonparametrically from training data. KBP has the advantage that it may be used on any domain where kernels are defined (Rd, strings, groups), even where explicit parametric models are not known, or closed form expressions for the BP updates do not exist. The computational cost of message updates in KBP is polynomial in the training data size. We also propose a constant time approximate message update procedure by representing messages using a small number of basis functions. In experiments, we apply KBP to image denoising, depth prediction from still images, and protein configuration prediction: KBP is faster than competing classical and nonparametric approaches (by orders of magnitude, in some cases), while providing significantly more accurate results.
Bickson Danny
Gretton Arthur
Guestrin Carlos
Low Yucheng
Song Le
No associations
LandOfFree
Kernel Belief Propagation does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Kernel Belief Propagation, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Kernel Belief Propagation will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-665868