Title :
Alopex algorithm for training multilayer neural networks
Author :
Venugopal, K.P. ; Pandya, A.S.
Author_Institution :
Dept. of Electr. Eng., Florida Atlantic Univ., FL, USA
Abstract :
The use of the Alopex algorithm for training multilayer neural networks is described. Alopex is a biologically influenced stochastic parallel process designed to find the global minimum of error surfaces. It has a number of advantages compared to other algorithms, such as backpropagation, reinforcement learning, and the Boltzmann machine. The authors investigate the efficacy of the algorithm for faster convergence by considering different error functions. They discuss the specifics of the algorithm for applications involving learning tasks. Results of computer simulations with standard problems such as XOR, parity, symmetry, and encoders of different dimensions are also presented and compared with those obtained using backpropagation. A temperature perturbation scheme is proposed which allows the algorithm to get out of strong local minima
Keywords :
learning systems; neural nets; parallel algorithms; Alopex algorithm; XOR; convergence; encoders; error surfaces; learning systems; local minima; multilayer neural networks; parity; stochastic parallel process; symmetry; temperature perturbation; Application software; Backpropagation algorithms; Biological information theory; Computer errors; Convergence; Learning; Multi-layer neural network; Neural networks; Process design; Stochastic processes;
Conference_Titel :
Neural Networks, 1991. 1991 IEEE International Joint Conference on
Print_ISBN :
0-7803-0227-3
DOI :
10.1109/IJCNN.1991.170403