Title :
Scalable techniques for computing band linear recurrences on massively parallel and vector supercomputers
Author :
Wang, Haigeng ; Nicolau, Alexandru ; Keung, Stepen ; Siu, Kai-Yeung Sunny
Author_Institution :
Dept. of Comput. Sci., California Univ., Irvine, CA, USA
Abstract :
Presents a new scalable algorithm, called the `regular schedule´, for parallel evaluation of band linear recurrences (BLRs), i.e. mth-order linear recurrences for m>1. Its scalability and simplicity make it well suited for vector supercomputers and massively parallel computers. We describe our implementation of the regular schedule on two types of machines: the Convex C240 and the MasPar MP-2. The scalability of our scheduling techniques is demonstrated on the two machines. Significant improvements in CPU performance for a range of programs containing BLRs implemented using the regular schedule in C over the same programs implemented using the highly-optimized coded-in-assembly BLAS routines are demonstrated on the Convex C240. We also demonstrate the scalability of this schedule on the MasPar MP-2 with up to 2000 processors. Our approach can be used both at the user level, in parallel programming code containing BLRs, and in compiler parallelization of such programs combined with recurrence recognition techniques for massively parallel and vector supercomputers
Keywords :
linear algebra; mathematics computing; parallel algorithms; parallel machines; parallel programming; performance evaluation; scheduling; subroutines; vector processor systems; C implementation; CPU performance; Convex C240; MasPar MP-2; band linear recurrences; basic linear algebra subroutines; compiler parallelization; highly-optimized coded-in-assembly BLAS routines; massively parallel computers; parallel evaluation; parallel programming code; recurrence recognition techniques; regular schedule; scalability; scalable algorithm; scheduling techniques; user level; vector supercomputers; Concurrent computing; Large-scale systems; Libraries; Linear systems; Parallel programming; Processor scheduling; Program processors; Scalability; Supercomputers; Vectors;
Conference_Titel :
Parallel Processing Symposium, 1994. Proceedings., Eighth International
Conference_Location :
Cancun
Print_ISBN :
0-8186-5602-6
DOI :
10.1109/IPPS.1994.288256