Title :
An efficient kernel normalized least mean square algorithm with compactly supported kernel
Author :
Toda, Osamu ; Yukawa, Masahiro
Author_Institution :
Dept. Electron. & Electr. Eng., Keio Univ., Yokohama, Japan
Abstract :
We investigate the use of compactly supported kernels (CSKs) for the kernel normalized least mean square (KNLMS) algorithm proposed initially by Richard et al. in 2009. The use of CSKs yields sparse kernelized input vectors, offering an opportunity for complexity reduction. We propose a simple two-step method to compute the kernelized input vectors efficiently. In the first step, it computes an over-estimation of the support of the kernelized input vector based on a certain ℓ1-ball. In the second step, it identifies the exact support by detailed examinations based on an ℓ2-ball. Also, we employ the identified support given by the second step for coherence construction. The proposed method reduces the amount of ℓ2-distance evaluations, leading to the complexity reduction. The numerical examples show that the proposed algorithm achieves significant complexity reduction.
Keywords :
computational complexity; learning (artificial intelligence); least mean squares methods; vectors; ℓ1-ball; ℓ2-ball; ℓ2-distance evaluations; CSK; KNLMS algorithm; coherence construction; compactly supported kernels; complexity reduction; kernel normalized least mean square algorithm; sparse kernelized input vectors; Coherence; Complexity theory; Dictionaries; Indexes; Kernel; Signal processing; Signal processing algorithms; Compactly supported function; Gaussian kernel; Kernel learning; Positive definite function; Radial basis function;
Conference_Titel :
Acoustics, Speech and Signal Processing (ICASSP), 2015 IEEE International Conference on
Conference_Location :
South Brisbane, QLD
DOI :
10.1109/ICASSP.2015.7178595