Title :
Digital pulse mode neuron with robust nonlinear activation function
Author_Institution :
Dept. of Comput. Sci. & Intelligent Syst., Oita Univ., Japan
Abstract :
This paper proposes a new type of digital synchronous pulse mode neuron with robust nonlinear activation function. Proposed neuron employs additive Gaussian random noise and exponential averaging for input signals to have stable internal potential. Theoretical analysis and simulations are carried out to verify the feasibility of the neuron. The results show that the activation function is invariable against the change of the number of inputs to the neuron. Experimental multilayer neural network is fabricated with the proposed neurons to perform binary classification problems. Experimental results show that the proposed neuron has comparable performance to other neurons while requiring less hardware and providing faster operation.
Keywords :
Gaussian noise; multilayer perceptrons; neural chips; nonlinear functions; additive Gaussian random noise; binary classification problems; digital synchronous pulse mode neuron; exponential averaging; multilayer neural network; robust nonlinear activation function; stable internal potential; Analytical models; Artificial neural networks; Circuits; Computer science; Multi-layer neural network; Neural networks; Neurons; Random number generation; Robustness; Signal generators;
Conference_Titel :
Neural Networks, 2004. Proceedings. 2004 IEEE International Joint Conference on
Print_ISBN :
0-7803-8359-1
DOI :
10.1109/IJCNN.2004.1381069