Title :
Acceleration of spiking neural networks in emerging multi-core and GPU architectures
Author :
Bhuiyan, Mansurul A. ; Pallipuram, Vivek K. ; Smith, Malcolm C.
Author_Institution :
Dept. of Electr. & Comput. Eng., Clemson Univ., Clemson, SC, USA
Abstract :
Recently, there has been strong interest in large-scale simulations of biological spiking neural networks (SNN) to model the human brain mechanisms and capture its inference capabilities. Among various spiking neuron models, the Hodgkin-Huxley model is the oldest and most compute intensive, whereas the more recent Izhikevich model is very compute efficient. Some of the recent multi-core processors and accelerators including Graphical Processing Units, IBM´s Cell Broadband Engine, AMD Opteron, and Intel Xeon can take advantage of task and thread level parallelism, making them good candidates for large-scale SNN simulations. In this paper we implement and analyze two character recognition networks based on these spiking neuron models. We investigate the performance improvement and optimization techniques for SNNs on these accelerators over an equivalent software implementation on a 2.66 GHz Intel Core 2 Quad. We report significant speedups of the two SNNs on these architectures. It has been observed that given proper application of optimization techniques, the commodity X86 processors are viable options for those applications that require a nominal amount of flops/byte. But for applications with a significant number of flops/byte, specialized architectures such as GPUs and cell processors can provide better performance. Our results show that a proper match of architecture with algorithm complexity provides the best performance.
Keywords :
computer graphic equipment; coprocessors; multiprocessing systems; neural net architecture; 2.66 GHz Intel Core 2 Quad; AMD Opteron; GPU architecture; Hodgkin-Huxley model; IBM cell broadband engine; Intel Xeon; Izhikevich model; X86 processor; character recognition network; graphical processing unit; human brain mechanisms; large scale simulation; multicore processor; spiking neural network; Biological neural networks; Biological system modeling; Biology computing; Brain modeling; Computational modeling; Computer architecture; Graphics processing unit; Large-scale systems; Multicore processing; Neural networks; Neurons;
Conference_Titel :
Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW), 2010 IEEE International Symposium on
Conference_Location :
Atlanta, GA
Print_ISBN :
978-1-4244-6533-0
DOI :
10.1109/IPDPSW.2010.5470899