Title :
An alternative approach to solve convergence problems in the backpropagation algorithm
Author :
Goedtel, Alessandro ; Silva, Ivan Nunes da ; Semi, Paulo Jose Amaral
Author_Institution :
Dept. of Electr. Eng., State Univ. of Sao Paulo, Brazil
Abstract :
The multilayer perceptron network has become one of the most used in the solution of a wide variety of problems. The training process is based on the supervised method, where the inputs are presented to the neural network and the output is compared with a desired value. However, the algorithm presents convergence problems when the desired output of the network has small slope in the discrete time samples or the output is a quasi-constant value. The proposal of this paper is presenting an alternative approach to solve this convergence problem with a pre-conditioning method of the desired output data set before the training process and a post-conditioning when the generalization results are obtained. Simulations results are presented in order to validate the proposed approach.
Keywords :
backpropagation; convergence; electrical engineering computing; generalisation (artificial intelligence); induction motors; multilayer perceptrons; backpropagation algorithm; convergence problems; discrete time samples; electrical engineering computing; generalization; induction motors; multilayer perceptron network; neural network; postconditioning method; preconditioning method; quasiconstant value; supervised method; training process; Backpropagation algorithms; Blind equalizers; Convergence; Encoding; Frequency division multiplexing; Learning automata; Least squares methods; Multilayer perceptrons; Neural networks; Proposals;
Conference_Titel :
Neural Networks, 2004. Proceedings. 2004 IEEE International Joint Conference on
Print_ISBN :
0-7803-8359-1
DOI :
10.1109/IJCNN.2004.1380074