Title :
Scalable implementations of MPI atomicity for concurrent overlapping I/O
Author :
Liao, Wei-keng ; Choudhary, Alok ; Coloma, Kenin ; Thiruvathukal, George K. ; Ward, Lee ; Russell, Eric ; Pundit, Neil
Author_Institution :
ECE Dept., Northwestern Univ., Evanston, IL
Abstract :
For concurrent I/O operations, atomicity defines the results in the overlapping file regions simultaneously read/written by requesting processes. Atomicity has been well studied at the file system level, such as POSIX standard. We investigate the problems arising from the implementation of MPI atomicity for concurrent overlapping write access and provide two programming solutions. Since the MPI definition of atomicity differs from the POSIX one, an implementation that simply relies on the POSIX file systems does not guarantee correct MPI semantics. To have a correct implementation of atomic I/O in MPI, we examine the efficiency of three approaches: I) file locking, 2) graph-coloring, and 3) process-rank ordering. Performance complexity for these methods are analyzed and their experimental results are presented for file systems including NFS, SGI´s XFS, and IBM´s GPFS
Keywords :
computational complexity; graph colouring; message passing; multiprocessing programs; network operating systems; parallel machines; IBM GPFS file system; MPI atomicity implementations; MPI semantics; NFS file system; POSIX file systems; SGI XFS file system; concurrent overlapping I/O operations; file locking; graph-coloring; message passing interface; parallel machines; performance complexity; process-rank ordering; Application software; Bandwidth; Concurrent computing; File systems; Hardware; Laboratories; Large-scale systems; Multidimensional systems; Performance analysis; Programming;
Conference_Titel :
Parallel Processing, 2003. Proceedings. 2003 International Conference on
Conference_Location :
Kaohsiung
Print_ISBN :
0-7695-2017-0
DOI :
10.1109/ICPP.2003.1240586