A systematic multi-step methodology for performance analysis of communication traces of distributed applications based on hierarchical clustering

Author

Aguilera, Gaby ; Teller, Patricia J. ; Taufer, Michela ; Wolf, Felix

Author_Institution

Texas Univ., El Paso, TX

fYear

2006

fDate

25-29 April 2006

Abstract

Often parallel scientific applications are instrumented and traces are collected and analyzed to identify processes with performance problems or operations that cause delays in program execution. The execution of instrumented codes may generate large amounts of performance data, and the collection, storage, and analysis of such traces are time and space demanding. To address this problem, this paper presents an efficient, systematic, multi-step methodology, based on hierarchical clustering, for analysis of communication traces of parallel scientific applications. The methodology is used to discover potential communication performance problems of three applications: TRACE, REMO, and SWEEP3D

Keywords

parallel processing; pattern clustering; REMO; SWEEP3D; TRACE; communication performance; communication trace; distributed application; hierarchical clustering; parallel scientific application; systematic multistep methodology; Counting circuits; Data analysis; Delay; Instruments; Large-scale systems; Monitoring; Parallel algorithms; Parallel processing; Performance analysis; Statistical analysis;

fLanguage

English

Publisher

ieee

Conference_Titel

Parallel and Distributed Processing Symposium, 2006. IPDPS 2006. 20th International

Conference_Location

Rhodes Island

Print_ISBN

1-4244-0054-6

Type

conf

DOI

10.1109/IPDPS.2006.1639645

Filename

1639645