• DocumentCode
    1222614
  • Title

    A CramÉr-Rao Bound Characterization of the EM-Algorithm Mean Speed of Convergence

  • Author

    Herzet, Cédric ; Ramon, Valéry ; Renaux, Alexandre ; Vandendorpe, Luc

  • Author_Institution
    INRIA/IRISA, Univ. de Beaulieu, Rennes
  • Volume
    56
  • Issue
    6
  • fYear
    2008
  • fDate
    6/1/2008 12:00:00 AM
  • Firstpage
    2218
  • Lastpage
    2228
  • Abstract
    This paper deals with the mean speed of convergence of the expectation-maximization (EM) algorithm. We show that the asymptotic behavior (in terms of the number of observations) of the EM algorithm can be characterized as a function of the Cramer-Rao bounds (CRBs) associated to the so-called incomplete and complete data sets defined within the EM-algorithm framework. We particularize our result to the case of a complete data set defined as the concatenation of the observation vector and a vector of nuisance parameters, independent of the parameter of interest. In this particular case, we show that the CRB associated to the complete data set is nothing but the well-known modified CRB. Finally, we show by simulation that the proposed expression enables to properly characterize the EM-algorithm mean speed of convergence from the CRB behavior when the size of the observation set is large enough.
  • Keywords
    convergence of numerical methods; expectation-maximisation algorithm; iterative methods; Cramer-Rao bound characterization; convergence of numerical methods; expectation-maximization algorithm; iterative methods; Convergence; Genetic expression; Iterative algorithms; Iterative methods; Laboratories; Maximum likelihood estimation; Phase estimation; Remote sensing; Robustness; State estimation; Convergence of numerical methods; iterative methods; maximum-likelihood estimation;
  • fLanguage
    English
  • Journal_Title
    Signal Processing, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1053-587X
  • Type

    jour

  • DOI
    10.1109/TSP.2008.917024
  • Filename
    4524048