HIO: A Library for High Performance I/O and Data Management

Author

Dai, William W.

fYear

2011

fDate

16-20 May 2011

Firstpage

1759

Lastpage

1766

Abstract

A library for parallel IO and data management has been developed for large-scale multi-physics simulations. The goal of the library is to provide sustainable, interoperable, efficient, scalable, and convenient tools for parallel IO and data management for high-level data structures in applications, and to provide tools for the connection between applications. The high-level data structures include one- and multi-dimensional arrays, structured meshes, unstructured meshes, and the meshes generated through adaptive mesh refinement. The IO mechanism can be collective and non-collective. The data objects suitable for the library could be either large or small data sets. Even for small data sets, the IO performance is close to one of MPI-IO performance.

Keywords

data structures; mesh generation; parallel databases; HIO; adaptive mesh refinement; data management; data objects; high performance I/O management; high-level data structures; large-scale multiphysics simulations; multidimensional arrays; parallel I/O management; Arrays; Computers; Libraries; Numerical simulation; Program processors; Writing;

fLanguage

English

Publisher

ieee

Conference_Titel

Parallel and Distributed Processing Workshops and Phd Forum (IPDPSW), 2011 IEEE International Symposium on

Conference_Location

Shanghai

ISSN

1530-2075

Print_ISBN

978-1-61284-425-1

Electronic_ISBN

1530-2075

Type

conf

DOI

10.1109/IPDPS.2011.333

Filename

6009043