DocumentCode
57883
Title
Hardware Friendly Probabilistic Spiking Neural Network With Long-Term and Short-Term Plasticity
Author
Hung-Yi Hsieh ; Kea-Tiong Tang
Author_Institution
Dept. of Electr. Eng., Nat. Tsing Hua Univ., Hsinchu, Taiwan
Volume
24
Issue
12
fYear
2013
fDate
Dec. 2013
Firstpage
2063
Lastpage
2074
Abstract
This paper proposes a probabilistic spiking neural network (PSNN) with unimodal weight distribution, possessing long- and short-term plasticity. The proposed algorithm is derived by both the arithmetic gradient decent calculation and bioinspired algorithms. The algorithm is benchmarked by the Iris and Wisconsin breast cancer (WBC) data sets. The network features fast convergence speed and high accuracy. In the experiment, the PSNN took not more than 40 epochs for convergence. The average testing accuracy for Iris and WBC data is 96.7% and 97.2%, respectively. To test the usefulness of the PSNN to real world application, the PSNN was also tested with the odor data, which was collected by our self-developed electronic nose (e-nose). Compared with the algorithm (K-nearest neighbor) that has the highest classification accuracy in the e-nose for the same odor data, the classification accuracy of the PSNN is only 1.3% less but the memory requirement can be reduced at least 40%. All the experiments suggest that the PSNN is hardware friendly. First, it requires only nine-bits weight resolution for training and testing. Second, the PSNN can learn complex data sets with a little number of neurons that in turn reduce the cost of VLSI implementation. In addition, the algorithm is insensitive to synaptic noise and the parameter variation induced by the VLSI fabrication. Therefore, the algorithm can be implemented by either software or hardware, making it suitable for wider application.
Keywords
VLSI; gradient methods; neural nets; pattern classification; Iris data sets; K-nearest neighbor; PSNN; VLSI fabrication; VLSI implementation; WBC; Wisconsin breast cancer data sets; arithmetic gradient decent calculation; bioinspired algorithms; classification accuracy; hardware friendly probabilistic spiking neural network; long-term plasticity; memory requirement; nine-bits weight resolution; short-term plasticity; unimodal weight distribution; Biological neural networks; Encoding; Neurons; Probabilistic logic; Signal processing algorithms; Training; Gradient descent learning; Hebbian learning; hardware compatible; probabilistic spiking neural network; resolution requirement reduction; short-term plasticity;
fLanguage
English
Journal_Title
Neural Networks and Learning Systems, IEEE Transactions on
Publisher
ieee
ISSN
2162-237X
Type
jour
DOI
10.1109/TNNLS.2013.2271644
Filename
6568002
Link To Document