Title :
Variational Bayes and Mean Field Approximations for Markov field unsupervised estimation
Author :
Mohammad-Djafari, Ali ; Ayasso, Hacheme
Author_Institution :
Supelec, Lab. des Signaux et Syst., Univ .Paris Sud 11, Gif-sur-Yvette, France
Abstract :
We consider the problem of parameter estimation of Markovian models where the exact computation of the partition function is not possible or computationally too expensive with MCMC methods. The main idea is then to approximate the expression of the likelihood by a simpler one where we can either have an analytical expression or compute it more efficiently. We consider two approaches: Variational Bayes Approximation (VBA) and Mean Field Approximation (MFA) and study the properties of such approximations and their effects on the estimation of the parameters.
Keywords :
Bayes methods; Markov processes; approximation theory; parameter estimation; unsupervised learning; variational techniques; Markov field unsupervised estimation; mean field approximations; parameter estimation; variational Bayes approximations; Bayesian methods; Energy measurement; Entropy; Indium phosphide; Inverse problems; Parameter estimation; Physics; Pixel; Position measurement; Temperature;
Conference_Titel :
Machine Learning for Signal Processing, 2009. MLSP 2009. IEEE International Workshop on
Conference_Location :
Grenoble
Print_ISBN :
978-1-4244-4947-7
Electronic_ISBN :
978-1-4244-4948-4
DOI :
10.1109/MLSP.2009.5306261