A New Flexible MPI Collective I/O Implementation

Author

Coloma, Kenin ; Ching, Avery ; Choudhary, Alok ; Liao, Wei-keng ; Ross, Rob ; Thakur, Rajeev ; Ward, Lee

Author_Institution

Electr. & Comput. Eng. Dept., Northwestern Univ., Evanston, IL

fYear

2006

fDate

25-28 Sept. 2006

Firstpage

1

Lastpage

10

Abstract

The MPI-IO standard creates a huge opportunity to break out of the traditional file system I/O methods. As a software layer between the user and the file system, an MPI-IO library can potentially optimize I/O on behalf of the user with little to no user intervention. This is all possible because of the rich data description and communication infrastructure MPI-2 offers. Powerful data descriptions and some of the other desirable features of MPI-2, however, make MPI-IO challenging to implement. By creating a new collective I/O implementation that allows developers to easily tinker and play with new optimizations or combinations of different techniques, research can proceed faster and be quickly and reliably deployed

Keywords

file organisation; input-output programs; message passing; software libraries; MPI collective I/O implementation; MPI-2; MPI-IO library; communication infrastructure; data description; file system I/O methods; software layer; Computational modeling; Computer science; Concurrent computing; File systems; Laboratories; Mathematics; Power system modeling; Power system reliability; Read-write memory; Software libraries;

fLanguage

English

Publisher

ieee

Conference_Titel

Cluster Computing, 2006 IEEE International Conference on

Conference_Location

Barcelona

ISSN

1552-5244

Print_ISBN

1-4244-0327-8

Electronic_ISBN

1552-5244

Type

conf

DOI

10.1109/CLUSTR.2006.311865

Filename

4100371