DocumentCode :
2720063
Title :
Noncontiguous I/O through PVFS
Author :
Ching, Avery ; Choudhary, Alok ; Liao, Wei-keng ; Ross, Rob ; Gropp, William
Author_Institution :
Center for Parallel & Distributed Comput., Northwestern Univ., Evanston, IL, USA
fYear :
2002
fDate :
2002
Firstpage :
405
Lastpage :
414
Abstract :
With the tremendous advances in processor and memory technology, I/O has risen to become the bottleneck in high-performance computing for many applications. The development of parallel file systems has helped to ease the performance gap, but I/O still remains an area needing significant performance improvement. Research has found that noncontiguous I/O access patterns in scientific applications combined with current file system methods, to perform these accesses lead to unacceptable performance for large data sets. To enhance performance of noncontiguous I/O, we have created list I/O, a native version of noncontiguous I/O. We have used the Parallel Virtual File System (PVFS) to implement our ideas. Our research and experimentation shows that list I/O outperforms current noncontiguous I/O access methods in most I/O situations and can substantially enhance the performance of real-world scientific applications.
Keywords :
client-server systems; file organisation; input-output programs; parallel memories; virtual storage; workstation clusters; Linux clusters; Parallel Virtual File System; cluster computing; high-performance computing; noncontiguous I/O; performance improvement; Application software; Computer science; Concurrent computing; Costs; Distributed computing; File servers; File systems; Linux; Mathematics; Network servers;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Cluster Computing, 2002. Proceedings. 2002 IEEE International Conference on
Print_ISBN :
0-7695-2066-9
Type :
conf
DOI :
10.1109/CLUSTR.2002.1137773
Filename :
1137773
Link To Document :
بازگشت