Title :
A modified gradient-based backpropagation training method for neural networks
Author :
Mu, Xuewen ; Zhang, Yaling
Author_Institution :
Dept. of Appl. Math., Xidian Univ., Xi´´an, China
Abstract :
A improved gradient-based backpropagation training method is proposed for neural networks in this paper. Based on the Barzilai and Borwein steplength update and some technique of Resilient Propagation method, we adapt the new learning rate to improves the speed and the success rate. Experimental results show that the proposed method has considerably improved convergence speed, and for the chosen test problems, outperforms other well-known training methods.
Keywords :
backpropagation; gradient methods; neural nets; Barzilai steplength update; Borwein steplength update; Resilient Propagation method; modified gradient-based backpropagation training method; neural networks; Artificial neural networks; Backpropagation algorithms; Biology; Computer science; Convergence; Information processing; Iterative algorithms; Mathematics; Neural networks; Testing; Barzilai and Borwein steplength; Resilient Propagation method; backpropagation training method;
Conference_Titel :
Granular Computing, 2009, GRC '09. IEEE International Conference on
Conference_Location :
Nanchang
Print_ISBN :
978-1-4244-4830-2
DOI :
10.1109/GRC.2009.5255081