DocumentCode
3506109
Title
Connection between annealed free energy and belief propagation on random factor graph ensembles
Author
Mori, Ryuhei
Author_Institution
Grad. Sch. of Inf., Kyoto Univ., Kyoto, Japan
fYear
2011
fDate
July 31 2011-Aug. 5 2011
Firstpage
2010
Lastpage
2014
Abstract
Recently, Vontobel showed the relationship between Bethe free energy and annealed free energy for protograph factor graph ensembles. In this paper, annealed free energy of any random regular factor graph ensembles are connected to Bethe free energy. The annealed free energy is expressed as the solution of maximization problem whose stationary condition coincides with equations of belief propagation since the contribution to partition function of particular type of variable and factor nodes has similar form of minus Bethe free energy. It gives simple derivation of quenched free energy by using the replica method. It implies equivalence of the replica and cavity methods for any random irregular factor graph ensembles. As consequence, it is shown that the replica symmetric solution and annealed free energy are equal for regular ensemble.
Keywords
belief networks; free energy; graph theory; optimisation; replica techniques; Bethe free energy; annealed free energy; belief propagation; cavity methods; maximization problem; partition function; protograph factor graph ensembles; quenched free energy; random regular factor graph ensembles; replica method; replica symmetric solution; stationary condition; Annealing; Approximation methods; Cavity resonators; Entropy; Equations; Mathematical model;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory Proceedings (ISIT), 2011 IEEE International Symposium on
Conference_Location
St. Petersburg
ISSN
2157-8095
Print_ISBN
978-1-4577-0596-0
Electronic_ISBN
2157-8095
Type
conf
DOI
10.1109/ISIT.2011.6033907
Filename
6033907
Link To Document