Title :
Exploiting Latent I/O Asynchrony in Petascale Science Applications
Author :
Payne, Mary ; Widener, Patrick ; Wolf, Matthew ; Abbasi, Hasan ; McManus, Scott ; Bridges, Patrick G. ; Schwan, Karsten
Author_Institution :
Dept. of Comput. Sci., Univ. of New Mexico, Albuquerque, NM
Abstract :
Current and emerging large-scale HPC applications face daunting I/O challenges. In existing codes, problems arise both from large data volumes and from the need to perform complex online data manipulations, including data staging, reorganization, and transformation. We describe three related techniques for enabling, encouraging, and exploiting latent I/O asynchrony in HPC applications: data taps, IOgraphs, and Metabots.
Keywords :
data handling; input-output programs; IOgraphs; Metabots; complex online data manipulations; data reorganization; data staging; data taps; data transformation; large-scale HPC applications; latent I-O asynchrony; petascale science applications; Application software; Bandwidth; Data mining; Filters; High performance computing; Monitoring; Network servers; Petascale computing; Routing; USA Councils; asynchronous I/O; high performance computing;
Conference_Titel :
eScience, 2008. eScience '08. IEEE Fourth International Conference on
Conference_Location :
Indianapolis, IN
Print_ISBN :
978-1-4244-3380-3
Electronic_ISBN :
978-0-7695-3535-7
DOI :
10.1109/eScience.2008.106
