Title :
Using program visualization for tuning parallel-loop scheduling
Author :
Hummel, Susan Flynn ; Kimelman, Doug ; Schonberg, Edith ; Tennenhouse, Marsha ; Zernik, Dror
Author_Institution :
Dept. of Comput. & Inf. Sci., Polytech. Univ., Brooklyn, NY, USA
Abstract :
Scheduling parallel programs optimally on multiple processors is difficult, partly because of interactions between applications, system software, and hardware having unexpected effects on performance. These interactions are hard to quantify and difficult to model. A convenient and effective means of quickly examining the behavior of such systems can make the evaluation and refinement of scheduling paradigms easier. The authors have used a program visualization tool called PV to help them develop and tune runtime systems for scheduling nested parallel loops on shared and distributed memory machines. In a series of experiments, PV gave feedback concerning the effectiveness of alternative algorithms and parameters. A prevalent and striking revelation of the visualizations was that, because of systemic effects, parallel loop iterations exhibit execution time variance, even when there is no algorithmic variance. This suggests that dynamic scheduling might be necessary to effectively use processors
Keywords :
parallel machines; parallel programming; processor scheduling; program diagnostics; visual programming; PV; algorithmic variance; distributed memory machines; dynamic scheduling; execution time variance; multiple processors; nested parallel loops; parallel loop iterations; parallel loop scheduling tuning; parallel programs; program visualization tool; runtime systems; scheduling paradigms; Data visualization; Displays; Hardware; Interference; Load management; Machine intelligence; Operating systems; Parallel machines; Processor scheduling; Runtime;
Journal_Title :
Concurrency, IEEE
DOI :
10.1109/4434.580440