Title :
Multiple neural networks and weighted voting
Author_Institution :
Dept. of Comput. Eng., Bogazici Univ., Istanbul, Turkey
fDate :
30 Aug-3 Sep 1992
Abstract :
Proposes to train a number of neural networks independently, either with different learning algorithms or with the same algorithm but with different sets of parameters and then take a vote over them in the form of a weighted majority. All the nets learn essentially the same task but converge to different solutions due to different learning parameter values, e.g. net structure. The voting schemes investigated are static vs. dynamic, where in dynamic voting scheme, the network complexity is also taken into account. The system assigns a weight of `confidence´ to each participating net proportional to the net´s success and complexity. An empirical work shows that having multiple nets significantly improves generalization, i.e., higher success is achieved in classifying previously unseen data. This framework is not limited to neural nets but can be applied to learning systems in general
Keywords :
learning systems; neural nets; dynamic voting scheme; learning algorithms; learning systems; network complexity; neural networks; static voting; weighted majority; weighted voting; Artificial neural networks; Computational modeling; Computer networks; Handwriting recognition; Learning systems; Nearest neighbor searches; Neural networks; Testing; Training data; Voting;
Conference_Titel :
Pattern Recognition, 1992. Vol.II. Conference B: Pattern Recognition Methodology and Systems, Proceedings., 11th IAPR International Conference on
Conference_Location :
The Hague
Print_ISBN :
0-8186-2915-0
DOI :
10.1109/ICPR.1992.201715