Title :
A Novel BP Algorithm Based on Self-adaptive Parameters and Performance Analysis
Author :
Cai, Haibin ; Liu, Liangxu ; Cao, Qiying
Author_Institution :
Coll. of Inf. Sci. & Technol., Donghua Univ., Shanghai
fDate :
Aug. 30 2006-Sept. 1 2006
Abstract :
The standard back-propagation(BP) algorithm converges slowly and is easy to trap into local minimum, which is the main reason why it cannot be used widely in practical applications. Therefore, a new BP algorithm based on self-adaptive parameters, called the SAPBP algorithm for short, is put forward in this paper. The convergence stability is enhanced by adding the positive matrix in Hessian matrix. The SAPBP algorithm is used in approximating nonlinear function in order to test its performance. The data of simulation experiment have proved that the improved algorithm can converges very fast and avoid trapping into local minimum. The convergence stability, also, is very good. The results demonstrate the proposed scheme is efficient, and has good performance
Keywords :
Hessian matrices; backpropagation; convergence of numerical methods; function approximation; neural nets; nonlinear functions; Hessian matrix; convergence stability; local minimum; nonlinear function approximation; self-adaptive parameter back-propagation algorithm; Algorithm design and analysis; Backpropagation algorithms; Convergence; Educational institutions; Error correction; Function approximation; Neurons; Performance analysis; Stability; Testing;
Conference_Titel :
Innovative Computing, Information and Control, 2006. ICICIC '06. First International Conference on
Conference_Location :
Beijing
Print_ISBN :
0-7695-2616-0
DOI :
10.1109/ICICIC.2006.213