Title :
Speed up method for neural network learning by using GPGPU
Author :
Tsuchida, Yukihiro ; Yoshioka, Michifumi
Author_Institution :
Dept. of Comput. Sci. & Intell. Syst., Osaka Prefecture Univ., Sakai, Japan
Abstract :
Neural network is a mathematical models for machine learning methods. This model apply to the many types of classification problem. And recently, many applications with neural network are required to process a big data in real time. In this paper, we discuss how to make the processing time of the neural network learning faster by using GPU. GPGPU is a technique by which GPUs are used for a general computation approach. GPU is a dedicated circuit to draw the graphics, so it has a characteristic in which many simple arithmetic circuits are implemented. This characteristic is applied to not only graphic processing but also general purpose like this proposed method. In order to employ it effectively, the calculation of the neural network learning are implemented to process simultaneously. The calculations which the neurons in the layer and many patterns are processed is parallelized. And we propose the parallelize method for calculation of back propagation. As the result, the proposed method is 25 times faster than the non-parallelized.
Keywords :
backpropagation; graphics processing units; neural nets; parallel processing; pattern classification; GPGPU; arithmetic circuit; backpropagation; data classification problem; general purpose graphics processing unit; machine learning method; neural network learning; parallelization method; speed up method;
Conference_Titel :
Soft Computing and Intelligent Systems (SCIS) and 13th International Symposium on Advanced Intelligent Systems (ISIS), 2012 Joint 6th International Conference on
Conference_Location :
Kobe
Print_ISBN :
978-1-4673-2742-8
DOI :
10.1109/SCIS-ISIS.2012.6505093