Title :
Quantized stochastic belief propagation: Efficient message-passing for continuous state spaces
Author :
Noorshams, N. ; Wainwright, Martin J.
Author_Institution :
Dept. of Electr. Eng. & Comput. Sci., Univ. of California, Berkeley, CA, USA
Abstract :
Belief propagation (BP) is a widely used algorithm for computing the marginal distributions in graphical models. However, in applications involving continuous random variables, the messages themselves are real-valued functions, which leads to significant computational bottlenecks. In this paper, we propose a low complexity method for performing belief propagation for continuous state space problems. Our algorithm, which we refer to as quantized stochastic belief propagation (QSBP), is a randomized variant of BP in which each node only passes stochastically chosen information at each round. The most attractive feature of QSBP is its significant gain in computational and communication efficiencies. In addition, we provide some theoretical guarantees including almost sure convergence and the rate of convergence for the case of tree-structured graphical models.
Keywords :
belief networks; computational complexity; convergence of numerical methods; iterative methods; message passing; random processes; stochastic processes; trees (mathematics); QSBP; communication efficiencies; computational efficiencies; continuous random variables; continuous state space problems; convergence rate; iterative algorithm; low-complexity method; marginal distribution computation; message passing; quantized stochastic belief propagation; randomized BP; real-valued functions; tree-structured graphical models; Approximation algorithms; Approximation methods; Belief propagation; Convergence; Graphical models; Stochastic processes; Vectors;
Conference_Titel :
Information Theory Proceedings (ISIT), 2012 IEEE International Symposium on
Conference_Location :
Cambridge, MA
Print_ISBN :
978-1-4673-2580-6
Electronic_ISBN :
2157-8095
DOI :
10.1109/ISIT.2012.6283055