Title :
A New Flexible MPI Collective I/O Implementation
Author :
Coloma, Kenin ; Ching, Avery ; Choudhary, Alok ; Liao, Wei-keng ; Ross, Rob ; Thakur, Rajeev ; Ward, Lee
Author_Institution :
Electr. & Comput. Eng. Dept., Northwestern Univ., Evanston, IL
Abstract :
The MPI-IO standard creates a huge opportunity to break out of the traditional file system I/O methods. As a software layer between the user and the file system, an MPI-IO library can potentially optimize I/O on behalf of the user with little to no user intervention. This is all possible because of the rich data description and communication infrastructure MPI-2 offers. Powerful data descriptions and some of the other desirable features of MPI-2, however, make MPI-IO challenging to implement. By creating a new collective I/O implementation that allows developers to easily tinker and play with new optimizations or combinations of different techniques, research can proceed faster and be quickly and reliably deployed
Keywords :
file organisation; input-output programs; message passing; software libraries; MPI collective I/O implementation; MPI-2; MPI-IO library; communication infrastructure; data description; file system I/O methods; software layer; Computational modeling; Computer science; Concurrent computing; File systems; Laboratories; Mathematics; Power system modeling; Power system reliability; Read-write memory; Software libraries;
Conference_Titel :
Cluster Computing, 2006 IEEE International Conference on
Conference_Location :
Barcelona
Print_ISBN :
1-4244-0327-8
Electronic_ISBN :
1552-5244
DOI :
10.1109/CLUSTR.2006.311865