• DocumentCode
    57883
  • Title

    Hardware Friendly Probabilistic Spiking Neural Network With Long-Term and Short-Term Plasticity

  • Author

    Hung-Yi Hsieh ; Kea-Tiong Tang

  • Author_Institution
    Dept. of Electr. Eng., Nat. Tsing Hua Univ., Hsinchu, Taiwan
  • Volume
    24
  • Issue
    12
  • fYear
    2013
  • fDate
    Dec. 2013
  • Firstpage
    2063
  • Lastpage
    2074
  • Abstract
    This paper proposes a probabilistic spiking neural network (PSNN) with unimodal weight distribution, possessing long- and short-term plasticity. The proposed algorithm is derived by both the arithmetic gradient decent calculation and bioinspired algorithms. The algorithm is benchmarked by the Iris and Wisconsin breast cancer (WBC) data sets. The network features fast convergence speed and high accuracy. In the experiment, the PSNN took not more than 40 epochs for convergence. The average testing accuracy for Iris and WBC data is 96.7% and 97.2%, respectively. To test the usefulness of the PSNN to real world application, the PSNN was also tested with the odor data, which was collected by our self-developed electronic nose (e-nose). Compared with the algorithm (K-nearest neighbor) that has the highest classification accuracy in the e-nose for the same odor data, the classification accuracy of the PSNN is only 1.3% less but the memory requirement can be reduced at least 40%. All the experiments suggest that the PSNN is hardware friendly. First, it requires only nine-bits weight resolution for training and testing. Second, the PSNN can learn complex data sets with a little number of neurons that in turn reduce the cost of VLSI implementation. In addition, the algorithm is insensitive to synaptic noise and the parameter variation induced by the VLSI fabrication. Therefore, the algorithm can be implemented by either software or hardware, making it suitable for wider application.
  • Keywords
    VLSI; gradient methods; neural nets; pattern classification; Iris data sets; K-nearest neighbor; PSNN; VLSI fabrication; VLSI implementation; WBC; Wisconsin breast cancer data sets; arithmetic gradient decent calculation; bioinspired algorithms; classification accuracy; hardware friendly probabilistic spiking neural network; long-term plasticity; memory requirement; nine-bits weight resolution; short-term plasticity; unimodal weight distribution; Biological neural networks; Encoding; Neurons; Probabilistic logic; Signal processing algorithms; Training; Gradient descent learning; Hebbian learning; hardware compatible; probabilistic spiking neural network; resolution requirement reduction; short-term plasticity;
  • fLanguage
    English
  • Journal_Title
    Neural Networks and Learning Systems, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    2162-237X
  • Type

    jour

  • DOI
    10.1109/TNNLS.2013.2271644
  • Filename
    6568002