Title :
Multi-threaded streamline tracing for data-intensive architectures
Author :
Ming Jiang ; Van Essen, Brian ; Harrison, Cyrus ; Gokhale, Maya
Author_Institution :
Lawrence Livermore Nat. Lab., Livermore, CA, USA
Abstract :
Streamline tracing is an important tool used in many scientific domains for visualizing and analyzing flow fields. In this work, we examine a shared memory multi-threaded approach to streamline tracing that targets emerging data-intensive architectures. We take an in-depth look at data management strategies for streamline tracing in terms of issues, such as memory latency, bandwidth, and capacity limitations, that are applicable to future HPC platforms. We present two data management strategies for streamline tracing and evaluate their effectiveness for data-intensive architectures with locally attached Flash. We provide a comprehensive evaluation of both strategies by examining the strong and weak scaling implications of a variety of parameters. We also characterize the relationship between I/O concurrency and I/O efficiency to guide the selection of strategy based on use case. From our experiments, we find that using kernel-managed memory-map for out-of-core streamline tracing can outperform optimized user-managed cache.
Keywords :
concurrency control; data analysis; data visualisation; flash memories; flow visualisation; multi-threading; physics computing; shared memory systems; storage management; Flash; HPC platform; I/O concurrency; I/O efficiency; bandwidth; capacity limitation; data management strategies; data-intensive architecture; flow field analysis; flow field visualization; kernel-managed memory-map; memory latency; multithreaded streamline tracing; out-of-core streamline tracing; scientific domain; shared memory multithreaded approach; Concurrent computing; Layout; Memory management; Nonvolatile memory; Random access memory; Standards; data management; data-intensive computing; memory-map; out-of-core algorithms; streamline tracing;
Conference_Titel :
Large Data Analysis and Visualization (LDAV), 2014 IEEE 4th Symposium on
Conference_Location :
Paris
DOI :
10.1109/LDAV.2014.7013199