DocumentCode
2769126
Title
Regularization for the kernel recursive least squares CMAC
Author
Laufer, C. ; Coghill, G.
Author_Institution
Electr. & Electron. Eng. Dept., Univ. of Auckland, Auckland, New Zealand
fYear
2012
fDate
10-15 June 2012
Firstpage
1
Lastpage
8
Abstract
The Cerebellar Model Articulation Controller (CMAC) neural network is an associative memory that is biologically inspired by the cerebellum, which is found in the brains of animals. In recent works, the kernel recursive least squares CMAC (KRLS-CMAC) was proposed as a superior alternative to the standard CMAC as it converges faster, does not require tuning of a learning rate parameter, and is much better at modeling. The KRLS-CMAC however, still suffered from the learning interference problem. Learning interference was addressed in the standard CMAC by regularization. Previous works have also applied regularization to kernelized CMACs, however they were not computationally feasible for large resolutions and dimensionalities. This paper brings the regularization technique to the KRLS-CMAC in a way that allows it to be used efficiently in multiple dimensions with infinite resolution kernel functions.
Keywords
cerebellar model arithmetic computers; convergence; learning (artificial intelligence); least squares approximations; recursive functions; CMAC neural network; KRLS-CMAC; biologically inspired associative memory; cerebellar model articulation controller; cerebellum; convergence; infinite resolution kernel function; kernel recursive least squares CMAC; learning interference problem; learning rate parameter; regularization technique; Dictionaries; Hypercubes; Interference; Kernel; Least squares approximation; Standards; Vectors;
fLanguage
English
Publisher
ieee
Conference_Titel
Neural Networks (IJCNN), The 2012 International Joint Conference on
Conference_Location
Brisbane, QLD
ISSN
2161-4393
Print_ISBN
978-1-4673-1488-6
Electronic_ISBN
2161-4393
Type
conf
DOI
10.1109/IJCNN.2012.6252367
Filename
6252367
Link To Document