Title :
Poisson approximation for excursions of adaptive algorithms
Author :
Zerai, Adel A. ; Bucklew, James A.
Author_Institution :
Dept. of Electron. Eng. Tech., Coll. of Technol. Studies, Shuwaikh, Kuwait
Abstract :
This paper analyzes excursions of adaptive algorithms. The distribution of the number of excursions in n units of time is approximated by a Poisson distribution. The mean and distribution of the time of the occurrence of the first excursion are approximated by those of an exponential distribution. Expressions for the error in the approximations are derived. The approximations are shown to hold asymptotically as the excursion defining set converges to the empty set and as the algorithm´s step size μ converges to zero. The validity of the approximations is tested on a variety of examples. The updates of the error between the estimated and optimal weights for many adaptive filters (for example the least mean square algorithm and its “signed” variants) are of the form of the equation given for the excursions of adaptive algorithms
Keywords :
Poisson distribution; adaptive filters; adaptive signal processing; convergence of numerical methods; exponential distribution; least mean squares methods; LMS algorithm; Poisson approximation; Poisson distribution; adaptive algorithms; adaptive filters; algorithm step size; approximation error; convergence; empty set; excursions; exponential distribution; least mean square algorithm; mean; Adaptive algorithm; Algorithm design and analysis; Educational institutions; Error correction; Lattices; Least squares approximation; Random variables; Size measurement; State-space methods; Testing;
Conference_Titel :
Information Theory, 1995. Proceedings., 1995 IEEE International Symposium on
Conference_Location :
Whistler, BC
Print_ISBN :
0-7803-2453-6
DOI :
10.1109/ISIT.1995.550405