Title :
Quantized Kernel Recursive Least Squares Algorithm
Author :
Badong Chen ; Songlin Zhao ; Pingping Zhu ; Principe, Jose C.
Author_Institution :
Inst. of Artificial Intell. & Robot., Xi´an Jiaotong Univ., Xi´an, China
Abstract :
In a recent paper, we developed a novel quantized kernel least mean square algorithm, in which the input space is quantized (partitioned into smaller regions) and the network size is upper bounded by the quantization codebook size (number of the regions). In this paper, we propose the quantized kernel least squares regression, and derive the optimal solution. By incorporating a simple online vector quantization method, we derive a recursive algorithm to update the solution, namely the quantized kernel recursive least squares algorithm. The good performance of the new algorithm is demonstrated by Monte Carlo simulations.
Keywords :
Monte Carlo methods; least mean squares methods; regression analysis; vector quantisation; Monte Carlo simulations; input space; network size; online vector quantization method; quantization codebook size; quantized kernel least squares regression; quantized kernel recursive least mean squares algorithm; Kernel recursive least squares (KRLS); quantization; quantized kernel recursive least squares (QKRLS); sparsification;
Journal_Title :
Neural Networks and Learning Systems, IEEE Transactions on
DOI :
10.1109/TNNLS.2013.2258936