Title :
Entropy-based generation of supervised neural networks for classification of structured patterns
Author :
Tsai, Hsien-Leing ; Lee, Shie-Jue
Author_Institution :
Dept. of Electr. Eng., Nat. Sun Yat-Sen Univ., Kaohsiung, Taiwan
fDate :
3/1/2004 12:00:00 AM
Abstract :
Sperduti and Starita proposed a new type of neural network which consists of generalized recursive neurons for classification of structures. In this paper, we propose an entropy-based approach for constructing such neural networks for classification of acyclic structured patterns. Given a classification problem, the architecture, i.e., the number of hidden layers and the number of neurons in each hidden layer, and all the values of the link weights associated with the corresponding neural network are automatically determined. Experimental results have shown that the networks constructed by our method can have a better performance, with respect to network size, learning speed, or recognition accuracy, than the networks obtained by other methods.
Keywords :
entropy; multilayer perceptrons; pattern classification; acyclic structured patterns; entropy based generation; generalized recursive neurons; neural network supervision; pattern classification; Computer architecture; Information entropy; Mean square error methods; Medical diagnosis; Multilayer perceptrons; Neural networks; Neurofeedback; Neurons; Speech processing; Text processing; Entropy; Neural Networks (Computer);
Journal_Title :
Neural Networks, IEEE Transactions on
DOI :
10.1109/TNN.2004.824253