DocumentCode
2831716
Title
A Novel Learning Algorithm of Back-Propagation Neural Network
Author
Gong, Bing
Author_Institution
Sch. of Comput. Sci. & Technol., Heilongjiang Univ., Harbin, China
fYear
2009
fDate
11-12 July 2009
Firstpage
411
Lastpage
414
Abstract
Standard neural network based on back-propagation learning algorithm has some faults, such as low learning rate, instability, and long learning time. In this paper, we introduce trust-field method and bring forward a new learning factor, meanwhile we adopt Quasic-Newton algorithm to replace gradient descent algorithm. Three algorithms are utilized in the novel back-propagation neural network. Thus the neural network avoids the local minimum problem, improves the stability and reduces the training time and test time of learning and testing. Two concrete examples show the feasibility and validity of the new neural network.
Keywords
Newton method; backpropagation; gradient methods; minimisation; neural nets; back-propagation neural network learning algorithm; gradient descent algorithm; learning factor; learning instability; local minimum problem; quasicNewton algorithm; trust-field method; Automatic control; Automation; Backpropagation algorithms; Computer science; Control systems; Feedforward neural networks; Neural networks; Stability; Systems engineering and theory; Testing; Back-propagation learning algorithm (BPLA); quasic-Newton algorithm (QNA); self-adaptive learning factor; trust-field method (TFM);
fLanguage
English
Publisher
ieee
Conference_Titel
Control, Automation and Systems Engineering, 2009. CASE 2009. IITA International Conference on
Conference_Location
Zhangjiajie
Print_ISBN
978-0-7695-3728-3
Type
conf
DOI
10.1109/CASE.2009.146
Filename
5194479
Link To Document