• DocumentCode
    3452905
  • Title

    A synthesis of parallel out-of-core sorting programs on heterogeneous clusters

  • Author

    Cerin, Christophe ; Fkaier, H.

  • Author_Institution
    LaRIA, Univ. de Picardie Jules Verne, Amiens, France
  • fYear
    2003
  • fDate
    12-15 May 2003
  • Firstpage
    78
  • Lastpage
    85
  • Abstract
    The paper considers the problem of parallel external sorting in the context of a form of heterogeneous clusters. We introduce two algorithms and we compare them to another one that we have previously developed. Since most common sort algorithms assume high-speed random access to all intermediate memory, they are unsuitable if the values to be sorted don´t fit in main memory. This is the case for cluster computing platforms which are made of standard, cheap and scarce components. For that class of computing resources a good use of I/O operations compatible with the requirements of load balancing and computational complexity are the key to success. We explore three techniques and show how they can be deployed for clusters with processor performances related by a multiplicative factor. We validate the approaches in showing experimental results for the load balancing factor.
  • Keywords
    computational complexity; parallel algorithms; performance evaluation; resource allocation; sorting; workstation clusters; I/O management; cluster computing; computational complexity; data distribution; load balancing; out-of-core parallel sorting algorithm; over-partitioning; parallel integer sorting algorithm; processor performance; regular sampling; resource management; Bandwidth; Clustering algorithms; Computational complexity; Concurrent computing; Distributed computing; Load management; Performance evaluation; Resource management; Sampling methods; Sorting;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Cluster Computing and the Grid, 2003. Proceedings. CCGrid 2003. 3rd IEEE/ACM International Symposium on
  • Print_ISBN
    0-7695-1919-9
  • Type

    conf

  • DOI
    10.1109/CCGRID.2003.1199355
  • Filename
    1199355