• DocumentCode
    1486588
  • Title

    Communication generation for aligned and cyclic(k) distributions using integer lattice

  • Author

    Tseng, Eric Hung-Yu ; Gaudlot, J.-L.

  • Author_Institution
    Dept. of Electr. Eng. Syst., Univ. of Southern California, Los Angeles, CA, USA
  • Volume
    10
  • Issue
    2
  • fYear
    1999
  • fDate
    2/1/1999 12:00:00 AM
  • Firstpage
    136
  • Lastpage
    146
  • Abstract
    Optimizing communication is a key issue in generating efficient SPMD codes in compiling distributed arrays on data parallel languages, such as High Performance Fortran. In HPF, the array distribution may involve alignment and cyclic(k)-distribution such that the enumeration of the local set and the enumeration of the communication set exhibit regular patterns which can be modeled as integer lattices. In the special case of unit-strided alignment, many techniques of the communication set enumeration have been proposed, while in the general case of the non-unit-strided alignment, inspector-like run-time codes are needed to build repeating pattern table or to scan over local elements such that the communication set can be constructed. Unlike other works on this problem of the general alignment and cyclic(k) distribution, our approach derives an algebraic solution for such an integer lattice that models the communication set by using the Smith-Normal-Form analysis, therefore, efficient enumeration of the communication set can be generated. Based on the integer lattice, we also present our algorithm for the SPMD code generation. In our approach, when the parameters are known, the SPMD program can be efficiently constructed without any inspector-like run-time codes
  • Keywords
    FORTRAN; message passing; parallel languages; program compilers; HPF; High Performance Fortran; SPMD codes; Smith-Normal-Form analysis; aligned distributions; communication generation; communication set; cyclic(k) distributions; data parallel languages; distributed arrays; inspector-like run-time codes; integer lattice; integer lattices; Computational modeling; Delay; Equations; Lattices; Message passing; Parallel languages; Program processors; Programming profession; Runtime;
  • fLanguage
    English
  • Journal_Title
    Parallel and Distributed Systems, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1045-9219
  • Type

    jour

  • DOI
    10.1109/71.752780
  • Filename
    752780