Title :
Indicators of input contributions: comparing functional measures
Author :
Gedeon, Tamás D.
Author_Institution :
Sch. of Comput. Sci. & Eng., New South Wales Univ., Sydney, NSW, Australia
Abstract :
The problem of data encoding and feature selection for training backpropagation neural networks is well known. The basic principles are to avoid encrypting the underlying structure of the data, and to avoid using irrelevant inputs. In the real world we often receive data which has been processed by at least one previous user. The data may contain too many instances of some class, too few instances of other classes, and often include many irrelevant or redundant fields. Previous approaches have focussed on the analysis of the weight matrix of trained networks to determine the magnitude of contribution particular inputs make to the output to determine which are less significant. This paper examines measures to determine the functional contribution of inputs to outputs. Inputs which include minor but unique information to the network are more significant than inputs with higher magnitude contribution but providing redundant information also provided by another input. This paper presents a novel functional analysis of the weight matrix based on a technique developed for determining the behavioural significance of hidden neurons. This is compared with the application of the same technique to the training and test data available. Finally, a novel aggregation technique is introduced
Keywords :
backpropagation; encoding; functional analysis; matrix algebra; neural nets; pattern classification; aggregation technique; backpropagation neural networks; data encoding; feature selection; functional analysis; functional measures; hidden neurons; input contributions; training; weight matrix; Computational modeling; Computer networks; Loss measurement; Medical simulation; Neurons; Particle measurements; Simulated annealing; Size measurement; Testing; Vector quantization;
Conference_Titel :
TENCON '96. Proceedings., 1996 IEEE TENCON. Digital Signal Processing Applications
Conference_Location :
Perth, WA
Print_ISBN :
0-7803-3679-8
DOI :
10.1109/TENCON.1996.608395