Title :
A synthesis of parallel out-of-core sorting programs on heterogeneous clusters
Author :
Cerin, Christophe ; Fkaier, H.
Author_Institution :
LaRIA, Univ. de Picardie Jules Verne, Amiens, France
Abstract :
The paper considers the problem of parallel external sorting in the context of a form of heterogeneous clusters. We introduce two algorithms and we compare them to another one that we have previously developed. Since most common sort algorithms assume high-speed random access to all intermediate memory, they are unsuitable if the values to be sorted don´t fit in main memory. This is the case for cluster computing platforms which are made of standard, cheap and scarce components. For that class of computing resources a good use of I/O operations compatible with the requirements of load balancing and computational complexity are the key to success. We explore three techniques and show how they can be deployed for clusters with processor performances related by a multiplicative factor. We validate the approaches in showing experimental results for the load balancing factor.
Keywords :
computational complexity; parallel algorithms; performance evaluation; resource allocation; sorting; workstation clusters; I/O management; cluster computing; computational complexity; data distribution; load balancing; out-of-core parallel sorting algorithm; over-partitioning; parallel integer sorting algorithm; processor performance; regular sampling; resource management; Bandwidth; Clustering algorithms; Computational complexity; Concurrent computing; Distributed computing; Load management; Performance evaluation; Resource management; Sampling methods; Sorting;
Conference_Titel :
Cluster Computing and the Grid, 2003. Proceedings. CCGrid 2003. 3rd IEEE/ACM International Symposium on
Print_ISBN :
0-7695-1919-9
DOI :
10.1109/CCGRID.2003.1199355