Title :
Kullback-Leibler approximation of spectral density functions
Author :
Georgiou, Tryphon T. ; Lindquist, Anders
Author_Institution :
Dept. of Electr. Eng., Minnesota Univ., Minneapolis, MN, USA
Abstract :
We introduce a Kullback-Leibler type distance between spectral density functions of stationary stochastic processes and solve the problem of optimal approximation of a given spectral density Ψ by one that is consistent with prescribed second-order statistics. In particular, we show (i) that there is a unique spectral density Φ which minimizes this Kullback-Leibler distance, (ii) that this optimal approximate is of the form Ψ/Q where the "correction term" Q is a rational spectral density function, and (iii) that the coefficients of Q can be obtained numerically by solving a suitable convex optimization problem. In the special case where Ψ=1, the convex functional becomes quadratic and the solution is then specified by linear equations.
Keywords :
function approximation; higher order statistics; optimisation; stochastic processes; Kullback-Leibler approximation; convex optimization; function approximation; linear equations; optimal approximation; second-order statistics; spectral density functions; stochastic processes; Context; Density functional theory; Entropy; Equations; Interpolation; Linear systems; Nonlinear filters; Statistics; Stochastic processes; White noise;
Conference_Titel :
Decision and Control, 2003. Proceedings. 42nd IEEE Conference on
Print_ISBN :
0-7803-7924-1
DOI :
10.1109/CDC.2003.1271815