DocumentCode
1222614
Title
A CramÉr-Rao Bound Characterization of the EM-Algorithm Mean Speed of Convergence
Author
Herzet, Cédric ; Ramon, Valéry ; Renaux, Alexandre ; Vandendorpe, Luc
Author_Institution
INRIA/IRISA, Univ. de Beaulieu, Rennes
Volume
56
Issue
6
fYear
2008
fDate
6/1/2008 12:00:00 AM
Firstpage
2218
Lastpage
2228
Abstract
This paper deals with the mean speed of convergence of the expectation-maximization (EM) algorithm. We show that the asymptotic behavior (in terms of the number of observations) of the EM algorithm can be characterized as a function of the Cramer-Rao bounds (CRBs) associated to the so-called incomplete and complete data sets defined within the EM-algorithm framework. We particularize our result to the case of a complete data set defined as the concatenation of the observation vector and a vector of nuisance parameters, independent of the parameter of interest. In this particular case, we show that the CRB associated to the complete data set is nothing but the well-known modified CRB. Finally, we show by simulation that the proposed expression enables to properly characterize the EM-algorithm mean speed of convergence from the CRB behavior when the size of the observation set is large enough.
Keywords
convergence of numerical methods; expectation-maximisation algorithm; iterative methods; Cramer-Rao bound characterization; convergence of numerical methods; expectation-maximization algorithm; iterative methods; Convergence; Genetic expression; Iterative algorithms; Iterative methods; Laboratories; Maximum likelihood estimation; Phase estimation; Remote sensing; Robustness; State estimation; Convergence of numerical methods; iterative methods; maximum-likelihood estimation;
fLanguage
English
Journal_Title
Signal Processing, IEEE Transactions on
Publisher
ieee
ISSN
1053-587X
Type
jour
DOI
10.1109/TSP.2008.917024
Filename
4524048
Link To Document