Title :
Initial analysis on sensitivity of multilayer perceptron
Author :
Yeung, D.S. ; Wang, X.Z.
Author_Institution :
Dept. of Comput., Hong Kong Polytech. Univ., Kowloon, Hong Kong
fDate :
6/21/1905 12:00:00 AM
Abstract :
One of the most important issues in the study of neural networks is its sensitivity arising from weight perturbation and input error, which may be caused by initial error, propagation or limited precision in data storage. It is difficult to establish a generic sensitivity formulation for the general multilayer perceptron. The paper continues our previous work on sensitivity analysis of the Neocognitron and makes an initial effort to analyze the sensitivity of a multilayer perceptron by following a similar method used in the case of the Neocognitron. Initial estimates on the expected decision error of an individual node due to the weight perturbation and on the expected decision error due to the input error are obtained. One general method is demonstrated by considering a special activation function for the multilayer perceptron. These preliminary investigations form the basis for our overall sensitivity analysis of the multilayer perceptron
Keywords :
multilayer perceptrons; sensitivity analysis; transfer functions; activation function; data storage; expected decision error; generic sensitivity formulation; initial error; input error; limited precision; propagation; weight perturbation; Computer networks; Equations; Guidelines; Hardware; Information geometry; Memory; Multilayer perceptrons; Neural networks; Neurons; Sensitivity analysis;
Conference_Titel :
Systems, Man, and Cybernetics, 1999. IEEE SMC '99 Conference Proceedings. 1999 IEEE International Conference on
Conference_Location :
Tokyo
Print_ISBN :
0-7803-5731-0
DOI :
10.1109/ICSMC.1999.823239