• DocumentCode
    3506109
  • Title

    Connection between annealed free energy and belief propagation on random factor graph ensembles

  • Author

    Mori, Ryuhei

  • Author_Institution
    Grad. Sch. of Inf., Kyoto Univ., Kyoto, Japan
  • fYear
    2011
  • fDate
    July 31 2011-Aug. 5 2011
  • Firstpage
    2010
  • Lastpage
    2014
  • Abstract
    Recently, Vontobel showed the relationship between Bethe free energy and annealed free energy for protograph factor graph ensembles. In this paper, annealed free energy of any random regular factor graph ensembles are connected to Bethe free energy. The annealed free energy is expressed as the solution of maximization problem whose stationary condition coincides with equations of belief propagation since the contribution to partition function of particular type of variable and factor nodes has similar form of minus Bethe free energy. It gives simple derivation of quenched free energy by using the replica method. It implies equivalence of the replica and cavity methods for any random irregular factor graph ensembles. As consequence, it is shown that the replica symmetric solution and annealed free energy are equal for regular ensemble.
  • Keywords
    belief networks; free energy; graph theory; optimisation; replica techniques; Bethe free energy; annealed free energy; belief propagation; cavity methods; maximization problem; partition function; protograph factor graph ensembles; quenched free energy; random regular factor graph ensembles; replica method; replica symmetric solution; stationary condition; Annealing; Approximation methods; Cavity resonators; Entropy; Equations; Mathematical model;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory Proceedings (ISIT), 2011 IEEE International Symposium on
  • Conference_Location
    St. Petersburg
  • ISSN
    2157-8095
  • Print_ISBN
    978-1-4577-0596-0
  • Electronic_ISBN
    2157-8095
  • Type

    conf

  • DOI
    10.1109/ISIT.2011.6033907
  • Filename
    6033907