Title :
Some enhancements of the constraint based decomposition training architecture
Author_Institution :
Dept. of Comput. Sci., St. Andrews Univ., UK
Abstract :
This paper presents three mechanisms: locking detection (LD), redundancy elimination (RE) and generalisation control (GC). Although originated, implemented and tested for the constraint based decomposition (CBD), LD and RE address general drawbacks of constructive algorithms and can be applied to other such algorithms, as well. LD stops the training of a hyperplane if its position is pin-pointed by nearby patterns, thus improving the training speed. RE reduces the number of hyperplanes used in the solution. RE works on-line during the training, thus eliminating the need for a separate pruning stage. Finally, GC addresses the generalisation properties of the solution. It is shown that CBD´s generalisation can be controlled by the user through the ordering of the pattern set. The experiments presented show that these mechanisms are effective on various types of problems
Keywords :
learning (artificial intelligence); neural nets; pattern classification; constraint based decomposition training architecture; constructive algorithms; generalisation control; locking detection; redundancy elimination; Backpropagation algorithms; Computer architecture; Multilayer perceptrons; Neurons; Testing;
Conference_Titel :
Neural Networks, 1996., IEEE International Conference on
Conference_Location :
Washington, DC
Print_ISBN :
0-7803-3210-5
DOI :
10.1109/ICNN.1996.548911