DocumentCode :
1015772
Title :
On Tests for Global Maximum of the Log-Likelihood Function
Author :
Blatt, Doron ; Hero, Alfred O., III
Author_Institution :
DRW Trading Group, Chicago
Volume :
53
Issue :
7
fYear :
2007
fDate :
7/1/2007 12:00:00 AM
Firstpage :
2510
Lastpage :
2525
Abstract :
Given the location of a relative maximum of the log-likelihood function, how to assess whether it is the global maximum? This paper investigates an existing statistical tool, which, based on asymptotic analysis, answers this question by posing it as a hypothesis testing problem. A general framework for constructing tests for global maximum is given. The characteristics of the tests are investigated for two cases: correctly specified model and model mismatch. A finite sample approximation to the power is given, which gives a tool for performance prediction and a measure for comparison between tests. The sensitivity of the tests to model mismatch is analyzed in terms of the Renyi divergence and the Kullback-Leibler divergence between the true underlying distribution and the assumed parametric class and tests that are insensitive to small deviations from the model are derived thereby overcoming a fundamental weakness of existing tests. The tests are illustrated for three applications: passive localization or direction finding using an array of sensors, estimating the parameters of a Gaussian mixture model, and estimation of superimposed exponentials in noise-problems that are known to suffer from local maxima.
Keywords :
Gaussian processes; approximation theory; array signal processing; maximum likelihood estimation; Gaussian mixture model; Kullback-Leibler divergence; Renyi divergence; asymptotic analysis; direction finding; finite sample approximation; global maximum; log-likelihood function; passive localization; statistical tool; Gaussian noise; Iterative algorithms; Maximum likelihood detection; Maximum likelihood estimation; Optimization methods; Parameter estimation; Power measurement; Sensor arrays; Signal processing algorithms; Testing; Array processing; Gaussian mixtures; global optimization; local maxima; maximum likelihood (ML); parameter estimation; superimposed exponentials in noise;
fLanguage :
English
Journal_Title :
Information Theory, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9448
Type :
jour
DOI :
10.1109/TIT.2007.899537
Filename :
4252319
Link To Document :
بازگشت