Maximum likelihood DOA estimation and asymptotic Cramer-Rao bounds for additive unknown colored noise

This paper is devoted to the maximum likelihood estimation of multiple sources in the presence of unknown noise. With the spatial noise covariance modeled as a function of certain unknown parameters, e.g., an autoregressive (AR) model, a direct and systematic way is developed to find the exact maximum likelihood (ML) estimates of all parameters associated with the direction finding problem, including the direction-of-arrival (DOA) angles Θ, the noise parameters α, the signal covariance Φ_s, and the noise power σ². We show that the estimates of the linear part of the parameter set Φ_s and σ² can be separated from the nonlinear parts Θ and α. Thus, the estimates of Φ_s and σ² become explicit functions of Θ and α. This results in a significant reduction in the dimensionality of the nonlinear optimization problem. Asymptotic analysis is performed on the estimates of Θ and α, and compact formulas are obtained for the Cramer-Rao bounds (CRB´s). Finally, a Newton-type algorithm is designed to solve the nonlinear optimization problem, and simulations show that the asymptotic CRB agrees well with the results from Monte Carlo trials, even for small numbers of snapshots