Title :
Asymptotic minimum discrimination information measure for asymptotically weakly stationary processes
Author :
Ephraim, Yariv ; Lev-Ari, Hanoch ; Gray, Robert M.
Author_Institution :
Inf. Syst. Lab., Stanford Univ., CA, USA
fDate :
9/1/1988 12:00:00 AM
Abstract :
An explicit expression is derived for the minimum discrimination information (MDI) measure with respect to Gaussian priors for sources characterized by their mean and by any principal leading block of their covariance matrix. An explicit expression is provided for the MDI extension of the given partial covariance of the source with respect to a Gaussian prior. For zero-mean sources and zero-mean Gaussian priors that are asymptotically weakly stationary (AWS) processes, it is shown that the asymptotic MDI measure equals half the Itakura-Saito distortion measure between the asymptotic power spectral densities of the source and prior. Asymptotic MDI modelling of a given AWS source by autoregressive and autoregressive moving average models, which are AWS models, is considered, and conditions are given for convergence of the sample covariance estimator of the source to the stationary covariance used in the modelling
Keywords :
information theory; matrix algebra; Gaussian priors; Itakura-Saito distortion measure; asymptotic minimum discrimination information measure; asymptotically weakly stationary processes; autoregressive model; autoregressive moving average models; convergence; covariance matrix; leading block; Autoregressive processes; Covariance matrix; Density measurement; Distortion measurement; Encoding; Helium; Power measurement; Predictive models; Speech analysis; Speech processing;
Journal_Title :
Information Theory, IEEE Transactions on