Title :
An adaptive kernel width update for correntropy
Author :
Zhao, Songlin ; Chen, Badong ; Príncipe, José C.
Author_Institution :
Dept. of Electr. & Comput. Eng., Univ. of Florida, Gainesville, FL, USA
Abstract :
Correntropy, as an adaptive criterion of Information Theoretic Learning (ITL), has been successfully used in signal processing and machine learning. How to appropriately select the kernel width of correntropy is a crucial problem in correntropy applications. Existing kernel width selection methods are not suitable enough for this problem. In this paper, we develop an adaptive method for kernel width selection in correntropy. Based on the Middleton´s non-Gaussian models, this method utilizes the kurtosis as a ratio to adjust the standard deviation of the prediction error to obtain the kernel width online. The superior performance of the new method has been demonstrated by simulation examples in the noisy frequency doubling and echo cancelation problems.
Keywords :
entropy; higher order statistics; learning (artificial intelligence); signal processing; Middleton nonGaussian models; adaptive criterion; adaptive kernel width update; correntropy applications; echo cancellation problem; information theoretic learning; kernel width selection; kurtosis utilization; machine learning; mean square error; noisy frequency doubling problem; second order statistics; signal processing; standard prediction error deviation; Adaptation models; Adaptive systems; Kernel; Noise; Random variables; Speech; Standards;
Conference_Titel :
Neural Networks (IJCNN), The 2012 International Joint Conference on
Conference_Location :
Brisbane, QLD
Print_ISBN :
978-1-4673-1488-6
Electronic_ISBN :
2161-4393
DOI :
10.1109/IJCNN.2012.6252495