DocumentCode :
402636
Title :
Parallel access to files in the Vesta file system
Author :
Corbett, Peter E. ; Feitelson, Dror G. ; Prost, Jean-Pierre ; Baylor, Sandra
Author_Institution :
IBM T.J. Watson Res. Center, Yorktown Heights, NY, USA
fYear :
1993
fDate :
15-19 Nov. 1993
Firstpage :
472
Lastpage :
481
Abstract :
The Vesta parallel file system is intended to solve the I/O problems of massively parallel multicomputers executing numerically intensive scientific applications. It provides parallel access from the applications to files distributed across multiple storage nodes in the multicomputer, thereby exposing an opportunity for high-bandwidth data transfer across the multicomputer´s low-latency network. The Vesta interface provides a user-defined parallel view of file data, which gives users some control over the layout of data. This is useful for tailoring data layout to much common access patterns. The interface also allows user-defined partitioning and repartitioning of files without moving data among storage nodes. Libraries with higher-level interfaces that hide the layout details, while exploiting the power of parallel access, may be implemented above the basic interface. It is shown how collective I/O operations can be implemented, and six parallel access modes to Vesta files are defined. Each mode has unique characteristics in terms of how the processes share the file and how their accesses are interleaved. The combination of user-defined file partitioning and the six access modes gives users very versatile parallel file access.
Keywords :
computer aided software engineering; file organisation; input-output programs; network operating systems; parallel programming; I/O problems; Vesta file system; Vesta interface; collective I/O operations; common access patterns; file data; high-bandwidth data transfer; higher-level interfaces; low-latency network; massively parallel multicomputers; multiple storage nodes; numerically intensive scientific applications; parallel access; parallel file access; parallel file system; repartitioning; user-defined parallel view; user-defined partitioning; Application software; Bandwidth; Concurrent computing; Delay; File systems; Hardware; Libraries; Microprocessors; Parallel processing; Pattern matching;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Supercomputing '93. Proceedings
ISSN :
1063-9535
Print_ISBN :
0-8186-4340-4
Type :
conf
DOI :
10.1109/SUPERC.1993.1263495
Filename :
1263495
Link To Document :
بازگشت