• DocumentCode
    1015772
  • Title

    On Tests for Global Maximum of the Log-Likelihood Function

  • Author

    Blatt, Doron ; Hero, Alfred O., III

  • Author_Institution
    DRW Trading Group, Chicago
  • Volume
    53
  • Issue
    7
  • fYear
    2007
  • fDate
    7/1/2007 12:00:00 AM
  • Firstpage
    2510
  • Lastpage
    2525
  • Abstract
    Given the location of a relative maximum of the log-likelihood function, how to assess whether it is the global maximum? This paper investigates an existing statistical tool, which, based on asymptotic analysis, answers this question by posing it as a hypothesis testing problem. A general framework for constructing tests for global maximum is given. The characteristics of the tests are investigated for two cases: correctly specified model and model mismatch. A finite sample approximation to the power is given, which gives a tool for performance prediction and a measure for comparison between tests. The sensitivity of the tests to model mismatch is analyzed in terms of the Renyi divergence and the Kullback-Leibler divergence between the true underlying distribution and the assumed parametric class and tests that are insensitive to small deviations from the model are derived thereby overcoming a fundamental weakness of existing tests. The tests are illustrated for three applications: passive localization or direction finding using an array of sensors, estimating the parameters of a Gaussian mixture model, and estimation of superimposed exponentials in noise-problems that are known to suffer from local maxima.
  • Keywords
    Gaussian processes; approximation theory; array signal processing; maximum likelihood estimation; Gaussian mixture model; Kullback-Leibler divergence; Renyi divergence; asymptotic analysis; direction finding; finite sample approximation; global maximum; log-likelihood function; passive localization; statistical tool; Gaussian noise; Iterative algorithms; Maximum likelihood detection; Maximum likelihood estimation; Optimization methods; Parameter estimation; Power measurement; Sensor arrays; Signal processing algorithms; Testing; Array processing; Gaussian mixtures; global optimization; local maxima; maximum likelihood (ML); parameter estimation; superimposed exponentials in noise;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2007.899537
  • Filename
    4252319