On Posterior Distributions for Signals in Gaussian Noise With Unknown Covariance Matrix

A Bayesian approach to estimate parameters of signals embedded in complex Gaussian noise with unknown color is presented. The study specifically focuses on a Bayesian treatment of the unknown noise covariance matrix making up a nuisance parameter in such problems. By integrating out uncertainties regarding the noise color, an enhanced ability to estimate both the signal parameters as well as properties of the error is exploited. Several noninformative priors for the covariance matrix, such as the reference prior, the Jeffreys prior, and modifications to this, are considered. Some of the priors result in analytical solutions, whereas others demand numerical approximations. In the linear signal model, connections are made between the standard Adaptive Maximum Likelihood (AML) estimate and a Bayesian solution using the Jeffreys prior. With adjustments to the Jeffreys prior, correspondence to the regularized solution is also established. This in turn enables a formal treatment of the regularization parameter. Simulations indicate that significant improvements, compared to the AML estimator, can be obtained by considering both the derived regularized solutions as well as the one obtained using the reference prior. The simulations also indicate the possibility of enhancing the predictions of properties of the error as uncertainties in the noise color are acknowledged.