Title :
Use of PVFS for efficient execution of jobs with pipeline-shared I/O
Author :
Vydyanathan, Nagavijayalakshmi ; Khanna, Gaurav ; Kurc, Tahsin ; Catalyurek, Umit ; Wyckoff, Pete ; Saltz, Joel ; Sadayappan, P.
Author_Institution :
Dept. of Comput. Sci. & Eng., Ohio State Univ., Columbus, OH, USA
Abstract :
This paper is concerned with efficient execution of applications that are composed of chain of sequential data processes, which exchange data through a file system. We focus on pipeline-shared I/O behavior within a single pipeline of processes running on a cluster. We examine several scheduling strategies and experimentally evaluate them for efficient use the parallel virtual file system (PVFS) as a common storage pool.
Keywords :
distributed databases; grid computing; parallel processing; pipeline processing; scheduling; virtual storage; workstation clusters; parallel virtual file system; pipeline-shared I/O; scheduling strategies; sequential data processes; Environmental management; File systems; Grid computing; Hardware; Large-scale systems; Pipelines; Processor scheduling; Resource management; Subcontracting; Supercomputers;
Conference_Titel :
Grid Computing, 2004. Proceedings. Fifth IEEE/ACM International Workshop on
Print_ISBN :
0-7695-2256-4
DOI :
10.1109/GRID.2004.63
