DocumentCode :
1926206
Title :
A scalable and generic task scheduling system for communication libraries
Author :
Trahay, Francois ; Denis, Alexandre
Author_Institution :
LaBRI, Univ. Bordeaux 1, Talence, France
fYear :
2009
fDate :
Aug. 31 2009-Sept. 4 2009
Firstpage :
1
Lastpage :
8
Abstract :
Since the advent of multi-core processors, the physionomy of typical clusters has dramatically evolved. This new massively multi-core era is a major change in architecture, causing the evolution of programming models towards hybrid MPI+threads, therefore requiring new features at low-level. Modern communication subsystems now have to deal with multi-threading: the impact of thread-safety, the contention on network interfaces or the consequence of data locality on performance have to be studied carefully. In this paper, we present PIOMan, a scalable and generic lightweight task scheduling system for communication libraries. It is designed to ensure concurrent progression of multiple tasks of a communication library (polling, offload, multi-rail) through the use of multiple cores, while preserving locality to avoid contention and allow a scalability to a large number of cores and threads. We have implemented the model, evaluated its performance, and compared it to state of the art solutions regarding overhead, scalability, and communication and computation overlap.
Keywords :
multi-threading; multiprocessing systems; processor scheduling; cluster architecture; communication libraries; generic task scheduling system; modern communication subsystems; multicore processors; multithreading; network interfaces; programming model evolution; scalable task scheduling system; thread-safety; Computer architecture; Engines; Genetic programming; Hardware; Libraries; Multicore processing; Multithreading; Network interfaces; Scalability; Yarn;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Cluster Computing and Workshops, 2009. CLUSTER '09. IEEE International Conference on
Conference_Location :
New Orleans, LA
ISSN :
1552-5244
Print_ISBN :
978-1-4244-5011-4
Electronic_ISBN :
1552-5244
Type :
conf
DOI :
10.1109/CLUSTR.2009.5289169
Filename :
5289169
Link To Document :
بازگشت