DocumentCode
3116246
Title
A Fixed-Point Minimum Error Entropy Algorithm
Author
Han, Seungiu ; Principe, Jose
Author_Institution
Dept. of Electr. & Comput. Eng., Florida Univ., Gainesville, FL
fYear
2006
fDate
6-8 Sept. 2006
Firstpage
167
Lastpage
172
Abstract
In this paper, we propose the fixed-point minimum error entropy (fixed-point MEE) as an alternative to the minimum error entropy (MEE) algorithm for training adaptive systems. The fixed-point algorithms are different from the gradient methods like MEE, and are proven to be faster, more stable and step-size free. This characteristic is due to the second order update similar to recursive least- squares (RLS) that tracks the Wiener solution with every update. We study the effect of design parameters, namely the forgetting factor, the window length, and the kernel size, on the convergence properties of the newly introduced recursive Fixed-Point MEE. Also, we test the performance of both the algorithms for two classic problems of system identification. Finally, we conclude that the Fixed-Point MEE performs better than MEE.
Keywords
adaptive systems; least squares approximations; minimum entropy methods; recursive estimation; Wiener solution; adaptive system training; convergence property; fixed-point minimum error entropy algorithm; forgetting factor; kernel size; recursive least squares; second order update; system identification; window length; Adaptive systems; Computer errors; Concurrent computing; Convergence; Entropy; Gradient methods; Kernel; Resonance light scattering; System identification; System testing;
fLanguage
English
Publisher
ieee
Conference_Titel
Machine Learning for Signal Processing, 2006. Proceedings of the 2006 16th IEEE Signal Processing Society Workshop on
Conference_Location
Arlington, VA
ISSN
1551-2541
Print_ISBN
1-4244-0656-0
Electronic_ISBN
1551-2541
Type
conf
DOI
10.1109/MLSP.2006.275542
Filename
4053641
Link To Document