Title :
Multikernel Least Mean Square Algorithm
Author :
Tobar, Felipe A. ; Sun-Yuan Kung ; Mandic, Danilo P.
Author_Institution :
Dept. of Electr. & Electron. Eng., Imperial Coll. London, London, UK
Abstract :
The multikernel least-mean-square algorithm is introduced for adaptive estimation of vector-valued nonlinear and nonstationary signals. This is achieved by mapping the multivariate input data to a Hilbert space of time-varying vector-valued functions, whose inner products (kernels) are combined in an online fashion. The proposed algorithm is equipped with novel adaptive sparsification criteria ensuring a finite dictionary, and is computationally efficient and suitable for nonstationary environments. We also show the ability of the proposed vector-valued reproducing kernel Hilbert space to serve as a feature space for the class of multikernel least-squares algorithms. The benefits of adaptive multikernel (MK) estimation algorithms are illuminated in the nonlinear multivariate adaptive prediction setting. Simulations on nonlinear inertial body sensor signals and nonstationary real-world wind signals of low, medium, and high dynamic regimes support the approach.
Keywords :
Hilbert spaces; least mean squares methods; signal processing; MK; adaptive multikernel estimation algorithms; adaptive sparsification criteria; adaptive vector-valued nonlinear signal estimation; adaptive vector-valued nonstationary signal estimation; dynamic regimes; finite dictionary; multikernel least mean square algorithm; multivariate input data; nonlinear inertial body sensor signals; nonlinear multivariate adaptive prediction setting; nonstationary real-world wind signals; time-varying vector-valued functions; vector-valued reproducing kernel Hilbert space; Algorithm design and analysis; Approximation algorithms; Estimation; Hilbert space; Kernel; Least squares approximations; Training; Adaptive sparsification; kernel methods; least mean square (LMS); multiple kernels; vector RKHS; wind prediction;
Journal_Title :
Neural Networks and Learning Systems, IEEE Transactions on
DOI :
10.1109/TNNLS.2013.2272594