Title :
A construction method of feedforward neural network for selecting effective hidden nodes
Author :
Su, Hui ; ZHAO, Bin ; XIA, Shaowei
Author_Institution :
Dept. of Autom., Tsinghua Univ., Beijing, China
Abstract :
Based on the analysis of construction methods proposed recently, a new construction method of feedforward neural network (FNN), which is called CMSEHN (construction method for selecting effective hidden nodes), is proposed for classification tasks in this paper. The most significant contribution of CMSEHN is that it guarantees the convergence of the learning procedure with fast speed, automatically determines the number of neurons in the hidden layer and selects much effective hidden nodes to improve the generalization ability of network. Also, CMSEHN can solve the two problems of the other construction methods, that are difficulty in improving generalization ability and difficulty in applying them to problems with analog input vectors of different length. In the meantime, the network constructed by CMSEHN is able to learn an arbitrary training set. Experiment results of handwritten digit recognition show that the network constructed by CMSEHN has good learning and generalization performance
Keywords :
convergence; feedforward neural nets; generalisation (artificial intelligence); learning (artificial intelligence); pattern classification; CMSEHN; FNN; construction method; effective hidden node selection; feedforward neural network construction; generalization ability; handwritten digit recognition; Automation; Buildings; Convergence; Feedforward neural networks; Handwriting recognition; Joining processes; Neural networks; Neurons; Surface treatment;
Conference_Titel :
Neural Networks,1997., International Conference on
Conference_Location :
Houston, TX
Print_ISBN :
0-7803-4122-8
DOI :
10.1109/ICNN.1997.614189