Title :
A New Algorithm for Raising the Training Speed of Process Neural Network
Author :
Liu, Zaiwen ; Wang, Xiaoyi ; Lian, Xiaoqin ; Wang, Zhengxiang
Author_Institution :
Sch. of Inf. Eng., Beijing Technol. & Bus. Univ.
Abstract :
Process neural network (PNN) is a new type of artificial neural network studied in recent year. PNN is an extent of traditional neural network, in which the inputs and outputs may be time-variation. Some modified algorithms for raising the training speed of PNN were investigated emphatically. These algorithms were based on function orthogonal basis expansion which exist low-speed convergence in network training. After introducing the improved algorithm which increased function momentum adjustment item and training rate automatic adjustment method for network weight function, and the normalizing rule on original algorithm, the sensitivity of error side particular was reduced, and the convergence of training was accelerated. The fact shows that the stability and training precision are improved with the learning rate automatic adjustment method, and it can also restrain the network falls into local least by introducing momentum adjustment item. A good result in application is represented by simulation
Keywords :
convergence; learning (artificial intelligence); neural nets; stability; artificial neural network; function momentum adjustment item; function orthogonal basis expansion; learning rate automatic adjustment method; network training; network weight function; process neural network; training speed; Acceleration; Artificial neural networks; Convergence; Discrete transforms; Helium; Neural networks; Neurons; Production; Sampling methods; Stability;
Conference_Titel :
Computational Intelligence and Security, 2006 International Conference on
Conference_Location :
Guangzhou
Print_ISBN :
1-4244-0605-6
Electronic_ISBN :
1-4244-0605-6
DOI :
10.1109/ICCIAS.2006.294151