DocumentCode
2356821
Title
Use of PVFS for efficient execution of jobs with pipeline-shared I/O
Author
Vydyanathan, Nagavijayalakshmi ; Khanna, Gaurav ; Kurc, Tahsin ; Catalyurek, Umit ; Wyckoff, Pete ; Saltz, Joel ; Sadayappan, P.
Author_Institution
Dept. of Comput. Sci. & Eng., Ohio State Univ., Columbus, OH, USA
fYear
2004
fDate
8 Nov. 2004
Firstpage
235
Lastpage
242
Abstract
This paper is concerned with efficient execution of applications that are composed of chain of sequential data processes, which exchange data through a file system. We focus on pipeline-shared I/O behavior within a single pipeline of processes running on a cluster. We examine several scheduling strategies and experimentally evaluate them for efficient use the parallel virtual file system (PVFS) as a common storage pool.
Keywords
distributed databases; grid computing; parallel processing; pipeline processing; scheduling; virtual storage; workstation clusters; parallel virtual file system; pipeline-shared I/O; scheduling strategies; sequential data processes; Environmental management; File systems; Grid computing; Hardware; Large-scale systems; Pipelines; Processor scheduling; Resource management; Subcontracting; Supercomputers;
fLanguage
English
Publisher
ieee
Conference_Titel
Grid Computing, 2004. Proceedings. Fifth IEEE/ACM International Workshop on
ISSN
1550-5510
Print_ISBN
0-7695-2256-4
Type
conf
DOI
10.1109/GRID.2004.63
Filename
1382836
Link To Document