Title :
A novel learning framework of CMAC via grey-area-time credit apportionment and grey learning rate
Author :
Chang, Po-lun ; Yang, Ying-kuei ; Shieh, Horng-lin
Author_Institution :
Dept. of Electr. Eng., Lunghwa Univ., taoyuan
Abstract :
The advantages of CMAC neural network are fast learning convergence, capable of mapping nonlinear functions quickly due to its local generalization of weight updating, simple architecture, easily processing and hardware implementation. In the training phase, the disadvantage of some CMAC models with a larger fixed learning rate is the unstable phenomenon. The smaller learning rate would cause slower convergence speed. In the aspect, we propose grey learning rate for training phase. We incorporate the grey relational analysis with the number of training iterations to get an adequate learning rate for better convergence performance. In addition, a serious problem of learning interference reduces learning speed and accuracy. The idea is that the error correcting must be proportional to the inverse of learning times, trained input area and grey relational grade for the addressed hyper cube. A credit apportionment adopts the idea to provide fast and accurate learning effects. This paper proposes a novel learning framework of CMAC for better performance and real-time applications. From the simulation results, it is evident that the proposed algorithm provides more accurate and fast convergence in the early cycles of training phase and also becomes significant in the follow-up cycles.
Keywords :
cerebellar model arithmetic computers; grey systems; learning systems; nonlinear functions; CMAC; grey learning rate; grey-area-time credit apportionment; neural network; nonlinear functions mapping; Acceleration; Convergence; Cybernetics; Electronic mail; Interference; Machine learning; Neural network hardware; Neural networks; Performance analysis; Quantization; CMAC; Learning interference; credit apportionment; grey relational analysis; grey relational grade;
Conference_Titel :
Machine Learning and Cybernetics, 2008 International Conference on
Conference_Location :
Kunming
Print_ISBN :
978-1-4244-2095-7
Electronic_ISBN :
978-1-4244-2096-4
DOI :
10.1109/ICMLC.2008.4620940