Local stability of Belief Propagation algorithm with multiple fixed points

07/19/2012
by   Victorin Martin, et al.
0

A number of problems in statistical physics and computer science can be expressed as the computation of marginal probabilities over a Markov random field. Belief propagation, an iterative message-passing algorithm, computes exactly such marginals when the underlying graph is a tree. But it has gained its popularity as an efficient way to approximate them in the more general case, even if it can exhibits multiple fixed points and is not guaranteed to converge. In this paper, we express a new sufficient condition for local stability of a belief propagation fixed point in terms of the graph structure and the beliefs values at the fixed point. This gives credence to the usual understanding that Belief Propagation performs better on sparse graphs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/10/2013

Belief Optimization for Binary Networks: A Stable Alternative to Loopy Belief Propagation

We present a novel inference algorithm for arbitrary, binary, undirected...
research
10/16/2012

A Cluster-Cumulant Expansion at the Fixed Points of Belief Propagation

We introduce a new cluster-cumulant expansion (CCE) based on the fixed p...
research
03/03/2011

Loopy Belief Propagation, Bethe Free Energy and Graph Zeta Function

We propose a new approach to the theoretical analysis of Loopy Belief Pr...
research
02/17/2010

Graph Zeta Function in the Bethe Free Energy and Loopy Belief Propagation

We propose a new approach to the analysis of Loopy Belief Propagation (L...
research
05/22/2015

Diffusion Methods for Classification with Pairwise Relationships

We define two algorithms for propagating information in classification p...
research
10/18/2020

Multi-agent Bayesian Learning with Adaptive Strategies: Convergence and Stability

We study learning dynamics induced by strategic agents who repeatedly pl...
research
07/04/2012

On the optimality of tree-reweighted max-product message-passing

Tree-reweighted max-product (TRW) message passing is a modified form of ...

Please sign up or login with your details

Forgot password? Click here to reset