The Role of Normalization in the Belief Propagation Algorithm

Details The Role of Normalization in the Belief Propagation Algorithm The Role of Normalization in the Belief Propagation Algorithm

2011-01-21

arxiv.org/abs/1101.4170v1

Computer Science

Learning

Scientific paper

An important part of problems in statistical physics and computer science can be expressed as the computation of marginal probabilities over a Markov Random Field. The belief propagation algorithm, which is an exact procedure to compute these marginals when the underlying graph is a tree, has gained its popularity as an efficient way to approximate them in the more general case. In this paper, we focus on an aspect of the algorithm that did not get that much attention in the literature, which is the effect of the normalization of the messages. We show in particular that, for a large class of normalization strategies, it is possible to focus only on belief convergence. Following this, we express the necessary and sufficient conditions for local stability of a fixed point in terms of the graph structure and the beliefs values at the fixed point. We also explicit some connexion between the normalization constants and the underlying Bethe Free Energy.

Affiliated with

Also associated with

No associations

Rating

The Role of Normalization in the Belief Propagation Algorithm does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with The Role of Normalization in the Belief Propagation Algorithm, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and The Role of Normalization in the Belief Propagation Algorithm will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-19476