Title :
Fast layer-by-layer training of the feedforward neural network classifier with genetic algorithm
Author :
Park, Lae-Jeong ; Park, Cheol Hoon
Author_Institution :
Dept. of Electr. Eng., Korea Adv. Inst. of Sci. & Technol., Taejon, South Korea
Abstract :
Because the error backpropagation learning algorithm is based on the steepest descent technique to train feedforward neural networks, its rate of convergence is slow due to the problem of local minima. We propose a new learning method for pattern classification using genetic algorithm and optimizing interconnection weights layer by layer by adding hidden layers one by one. Computer simulation shows that the layer-by-layer learning method has the fast convergence rate at the sacrifice of the size of the network.
Keywords :
backpropagation; convergence of numerical methods; feedforward neural nets; genetic algorithms; pattern classification; convergence rate; error backpropagation learning; feedforward neural network classifier; genetic algorithm; interconnection weight optimisation; layer-by-layer learning; pattern classification; steepest descent technique; Backpropagation algorithms; Clustering algorithms; Computer simulation; Convergence; Feedforward neural networks; Genetic algorithms; Learning systems; Neural networks; Optimization methods; Pattern classification;
Conference_Titel :
Neural Networks, 1993. IJCNN '93-Nagoya. Proceedings of 1993 International Joint Conference on
Print_ISBN :
0-7803-1421-2
DOI :
10.1109/IJCNN.1993.714255