Title :
Load balancing on PC clusters with the super-programming model
Author :
Jin, Dejiang ; Ziavras, Sotirios G.
Author_Institution :
Dept. of Electr. & Comput. Eng., New Jersey Inst. of Technol., Newark, NJ, USA
Abstract :
Recent work in high-performance computing has shifted attention to PC cluster. For PC-clusters, member nodes are independent computers connected by general-purpose networks. The latency of data communications is long and load balancing among the nodes becomes a critical issue. We introduce a new model for program development on PC clusters, namely the super-programming model (SPM) to address this issue. In SPM, PC clusters are modeled as a single virtual machine with PC as their processing units. The workload is modeled as a collection of super-instructions (SI). Each SI can achieve a limited workload. Application programs are coded using SI. SI is dynamically assigned to available PC at run time. For limited workload, no SI overloads any PC. Therefore, dynamic load balancing becomes an easier task. We apply SPM to mining association rules. Our experiments show that under normal conditions the workload is balanced very well. A performance model is also developed to describe the scalable behavior of SPM.
Keywords :
data communication; parallel programming; resource allocation; workstation clusters; PC clusters; association rule mining; data communications; high-performance computing; load balancing; parallel computing; super-instructions; super-programming model; virtual machine; Application software; Concurrent computing; Data communication; Data mining; Delay; Hardware; Load management; Parallel processing; Personal communication networks; Scanning probe microscopy;
Conference_Titel :
Parallel Processing Workshops, 2003. Proceedings. 2003 International Conference on
Print_ISBN :
0-7695-2018-9
DOI :
10.1109/ICPPW.2003.1240353