• DocumentCode
    67613
  • Title

    Rapid Feedforward Computation by Temporal Encoding and Learning With Spiking Neurons

  • Author

    Qiang Yu ; Huajin Tang ; Tan, Kay Chen ; Haizhou Li

  • Author_Institution
    Dept. of Electr. & Comput. Eng., Nat. Univ. of Singapore, Singapore, Singapore
  • Volume
    24
  • Issue
    10
  • fYear
    2013
  • fDate
    Oct. 2013
  • Firstpage
    1539
  • Lastpage
    1552
  • Abstract
    Primates perform remarkably well in cognitive tasks such as pattern recognition. Motivated by recent findings in biological systems, a unified and consistent feedforward system network with a proper encoding scheme and supervised temporal rules is built for solving the pattern recognition task. The temporal rules used for processing precise spiking patterns have recently emerged as ways of emulating the brain´s computation from its anatomy and physiology. Most of these rules could be used for recognizing different spatiotemporal patterns. However, there arises the question of whether these temporal rules could be used to recognize real-world stimuli such as images. Furthermore, how the information is represented in the brain still remains unclear. To tackle these problems, a proper encoding method and a unified computational model with consistent and efficient learning rule are proposed. Through encoding, external stimuli are converted into sparse representations, which also have properties of invariance. These temporal patterns are then learned through biologically derived algorithms in the learning layer, followed by the final decision presented through the readout layer. The performance of the model with images of digits from the MNIST database is presented. The results show that the proposed model is capable of recognizing images correctly with a performance comparable to that of current benchmark algorithms. The results also suggest a plausibility proof for a class of feedforward models of rapid and robust recognition in the brain.
  • Keywords
    brain; feedforward neural nets; image recognition; learning (artificial intelligence); MNIST database; anatomy; biological systems; biologically derived algorithms; brain; cognitive tasks; encoding scheme; feedforward models; feedforward system network; image recognition; learning layer; learning rule; physiology; precise spiking patterns; proper encoding method; rapid feedforward computation; real-world stimuli; sparse representations; spatiotemporal pattern recognition; spiking neurons; supervised temporal rules; temporal encoding; temporal patterns; unified computational model; Brain modeling; Computational modeling; Encoding; Feedforward neural networks; Neurons; Pattern recognition; Spatiotemporal phenomena; Pattern recognition; spatiotemporal patterns; spike-timing-dependent plasticity (STDP); spiking neural network (SNN); supervised learning; temporal encoding; temporal learning;
  • fLanguage
    English
  • Journal_Title
    Neural Networks and Learning Systems, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    2162-237X
  • Type

    jour

  • DOI
    10.1109/TNNLS.2013.2245677
  • Filename
    6469239