DocumentCode :
3254710
Title :
Profiling and Improving I/O Performance of a Large-Scale Climate Scientific Application
Author :
Zhuo Liu ; Bin Wang ; Teng Wang ; Yuan Tian ; Cong Xu ; Yandong Wang ; Weikuan Yu ; Cruz, Carlos A. ; Shujia Zhou ; Clune, Thomas ; Klasky, Scott
fYear :
2013
fDate :
July 30 2013-Aug. 2 2013
Firstpage :
1
Lastpage :
7
Abstract :
Exascale computing systems are soon to emerge, which will pose great challenges on the huge gap between computing and I/O performance. Many large-scale scientific applications play an important role in our daily life. The huge amounts of data generated by such applications require highly parallel and efficient I/O management policies. In this paper, we adopt a mission-critical scientific application, GEOS-5, as a case to profile and analyze the communication and I/O issues that are preventing applications from fully utilizing the underlying parallel storage systems. Through in-detail architectural and experimental characterization, we observe that current legacy I/O schemes incur significant network communication overheads and are unable to fully parallelize the data access, thus degrading applications´ I/O performance and scalability. To address these inefficiencies, we redesign its I/O framework along with a set of parallel I/O techniques to achieve high scalability and performance. Evaluation results on the NASA discover cluster show that our optimization of GEOS- 5 with ADIOS has led to significant performance improvements compared to the original GEOS-5 implementation.
Keywords :
geophysics computing; input-output programs; parallel architectures; parallel machines; parallel memories; ADIOS; GEOS-5 implementation; Goddard Earth Observing System model Version 5; I-O management policies; NASA; large-scale climate scientific application; mission-critical scientific application; network communication overheads; parallel storage system; Bandwidth; Libraries; Meteorology; NASA; Scalability; Synchronization; Writing;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Computer Communications and Networks (ICCCN), 2013 22nd International Conference on
Conference_Location :
Nassau
Print_ISBN :
978-1-4673-5774-6
Type :
conf
DOI :
10.1109/ICCCN.2013.6614174
Filename :
6614174
Link To Document :
بازگشت