Title :
Dynamic training rate for backpropagation learning algorithm
Author :
Al-Duais, M.S. ; Yaakub, A.R. ; Yusoff, Nooraini
Author_Institution :
Sch. of Comput., Univ. Utara Malaysia, Sintok, Malaysia
Abstract :
In this paper, we created a dynamic function training rate for the Back propagation learning algorithm to avoid the local minimum and to speed up training. The Back propagation with dynamic training rate (BPDR) algorithm uses the sigmoid function. The 2-dimensional XOR problem and iris data were used as benchmarks to test the effects of the dynamic training rate formulated in this paper. The results of these experiments demonstrate that the BPDR algorithm is advantageous with regards to both generalization performance and training speed. The stop training or limited error was determined by 1.0e-5.
Keywords :
backpropagation; 2D XOR problem; BPDR algorithm; Sigmoid function; backpropagation learning algorithm; dynamic function training rate; dynamic training rate algorithm; generalization performance; iris data; local minimum; training speed; Conferences; Equations; Heuristic algorithms; Iris; Neurons; Testing; Training; Artificial neural networks; Back propagation algorithm; adaptive training; dynamic training rate;
Conference_Titel :
Communications (MICC), 2013 IEEE Malaysia International Conference on
Conference_Location :
Kuala Lumpur
DOI :
10.1109/MICC.2013.6805839