Title :
Technique of learning rate estimation for efficient training of MLP
Author :
Golovko, Vladimir ; Savitsky, Yury ; Laopoulos, T. ; Sachenko, A. ; Grandinetti, L.
Author_Institution :
Brest Polytech. Inst., Russia
Abstract :
A new computational technique for training of multilayer feedforward neural networks with sigmoid activation function of the units is proposed. The proposed algorithm consists two phases. The first phase is an adaptive training step calculation, which implements the steepest descent method in the weight space. The second phase is estimation of calculated training step rate, which reaches a state of activity of the units for each training iteration. The simulation results are provided for the test example to demonstrate the efficiency of the proposed method, which solves the problem of training step choice in multilayer perceptrons
Keywords :
feedforward neural nets; learning (artificial intelligence); multilayer perceptrons; transfer functions; MLP; efficient training; learning rate estimation; multilayer feedforward neural networks; multilayer perceptrons; sigmoid activation function; training step choice; Artificial neural networks; Computer architecture; Convergence; Feedforward neural networks; Feedforward systems; Joining processes; Multi-layer neural network; Multilayer perceptrons; Neural networks; Neurons;
Conference_Titel :
Neural Networks, 2000. IJCNN 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on
Conference_Location :
Como
Print_ISBN :
0-7695-0619-4
DOI :
10.1109/IJCNN.2000.857856
