DocumentCode
688383
Title
A MapReduce Computing Framework Based on GPU Cluster
Author
Heng Gao ; Jie Tang ; Gangshan Wu
Author_Institution
Dept. of Comput. Sci. & Technol., Nanjing Univ., Nanjing, China
fYear
2013
fDate
13-15 Nov. 2013
Firstpage
1902
Lastpage
1907
Abstract
In recent years, GPU has become a power-efficient device for high performance computing and is widely used in highly parallel application. Its hierarchy of threads and memory has been proven successful for large scale multithread applications. However, how to efficiently program on GPU so as to fully utilize the computing power of GPUs is still a main problem for those potential users. We designed and implemented a new parallel GPU programming framework based on MapReduce. In our framework, a distributed file system (GlusterFS) was employed to store data distributely. The aim of the framework is to improve the efficiency, transparence and scalability of high performance computing on GPU clusters. The dynamic load balancing was taken into consideration more specifically. How typical tasks in oil industry are modified to fit into the framework was demonstrated. Prestack Kirchhoff time migration (PKTM) of seismic data was tested which achieved good acceleration performance.
Keywords
distributed databases; graphics processing units; multi-threading; petroleum industry; resource allocation; seismology; GPU cluster; GPU memory; GlusterFS; MapReduce computing framework; PKTM; distributed data storage; distributed file system; dynamic load balancing; efficiency improvement; high-performance computing; highly-parallel application; large-scale multithread applications; oil industry; parallel GPU programming framework; power-efficient device; prestack Kirchhoff time migration; scalability improvement; seismic data; thread hierarchy; transparence improvement; Data processing; Graphics processing units; High performance computing; Load management; Mars; Parallel processing; Programming; GPU Cluster; Load Balancing; MapReduce; Seismic migration;
fLanguage
English
Publisher
ieee
Conference_Titel
High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing (HPCC_EUC), 2013 IEEE 10th International Conference on
Conference_Location
Zhangjiajie
Type
conf
DOI
10.1109/HPCC.and.EUC.2013.273
Filename
6832156
Link To Document