Title :
Insights from the relationship between the multistage Wiener filter and the method of conjugate gradients
Author :
Weippert, Matthew E. ; Hiemstra, John D. ; Goldstein, J.Scott ; Zoltowski, Michael D.
Author_Institution :
SAIC, Chantilly, VA, USA
Abstract :
This paper demonstrates that, under certain conditions, the method of conjugate gradients (CG) and the multistage Wiener filter (MWF) produce equivalent solutions. Equivalence follows from the fact that both algorithms minimize the same cost function in the same subspace, namely a Krylov subspace. Motivation for Krylov subspaces and their properties are developed herein. New insights into both algorithms follow from the equivalence including previously unpublished results on the convergence of the multistage Wiener filter as a function of rank. Furthermore a new perspective on CG is developed where CG can now be viewed as a reduced rank algorithm for the solution of the Wiener-Hopf equations.
Keywords :
Wiener filters; conjugate gradient methods; filtering theory; integral equations; matrix algebra; Krylov subspaces; Wiener-Hopf equations solution; conjugate gradients; cost function minimization; equivalent solutions; matrix; multistage Wiener filter convergence; reduced rank algorithm; Character generation; Contracts; Convergence; Cost function; Couplings; Covariance matrix; Equations; Filter bank; Filtering; Wiener filter;
Conference_Titel :
Sensor Array and Multichannel Signal Processing Workshop Proceedings, 2002
Print_ISBN :
0-7803-7551-3
DOI :
10.1109/SAM.2002.1191067