A package for OpenCL based heterogeneous computing on clusters with many GPU devices

Author

Barak, Amnon ; Ben-Nun, Tal ; Levy, Ely ; Shiloh, Amnon

Author_Institution

Dept. of Comput. Sci., Hebrew Univ. of Jerusalem, Jerusalem, Israel

fYear

2010

fDate

20-24 Sept. 2010

Firstpage

1

Lastpage

7

Abstract

Heterogeneous systems provide new opportunities to increase the performance of parallel applications on clusters with CPU and GPU architectures. Currently, applications that utilize GPU devices run their device-executable code on local devices in their respective hosting-nodes. This paper presents a package for running OpenMP, C++ and unmodified OpenCL applications on clusters with many GPU devices. This Many GPUs Package (MGP) includes an implementation of the OpenCL specifications and extensions of the OpenMP API that allow applications on one hosting-node to transparently utilize cluster-wide devices (CPUs and/or GPUs). MGP provides means for reducing the complexity of programming and running parallel applications on clusters, including scheduling based on task dependencies and buffer management. The paper presents MGP and the performance of its internals.

Keywords

C++ language; application program interfaces; computer graphic equipment; computer graphics; formal specification; multiprocessing systems; parallel processing; scheduling; workstation clusters; C++; CPU architecture; GPU architecture; GPU devices; MGP; Many GPUs Package; OpenCL based heterogeneous computing; OpenCL specifications; OpenMP API; buffer management; cluster-wide devices; device-executable code; heterogeneous systems; hosting-nodes; parallel applications; scheduling; task dependency; unmodified OpenCL applications; Central Processing Unit; Complexity theory; Context; Graphics processing unit; Kernel; Libraries; Performance evaluation; GPGPU computing; HPC cluster; OpenCL; OpenMP; parallel applications;

fLanguage

English

Publisher

ieee

Conference_Titel

Cluster Computing Workshops and Posters (CLUSTER WORKSHOPS), 2010 IEEE International Conference on

Conference_Location

Heraklion, Crete

Print_ISBN

978-1-4244-8395-2

Electronic_ISBN

978-1-4244-8397-6

Type

conf

DOI

10.1109/CLUSTERWKSP.2010.5613086

Filename

5613086