• DocumentCode
    228695
  • Title

    Efficient I/O and Storage of Adaptive-Resolution Data

  • Author

    Kumar, Sudhakar ; Edwards, John ; Bremer, Peer-Timo ; Knoll, Aaron ; Christensen, Cameron ; Vishwanath, Venkatram ; Carns, Philip ; Schmidt, John A. ; Pascucci, V.

  • Author_Institution
    Sci. Comput. & Imaging Inst., Univ. of Utah, Salt Lake City, UT, USA
  • fYear
    2014
  • fDate
    16-21 Nov. 2014
  • Firstpage
    413
  • Lastpage
    423
  • Abstract
    We present an efficient, flexible, adaptive-resolution I/O framework that is suitable for both uniform and Adaptive Mesh Refinement (AMR) simulations. In an AMR setting, current solutions typically represent each resolution level as an independent grid which often results in inefficient storage and performance. Our technique coalesces domain data into a unified, multiresolution representation with fast, spatially aggregated I/O. Furthermore, our framework easily extends to importance-driven storage of uniform grids, for example, by storing regions of interest at full resolution and nonessential regions at lower resolution for visualization or analysis. Our framework, which is an extension of the PIDX framework, achieves state of the art disk usage and I/O performance regardless of resolution of the data, regions of interest, and the number of processes that generated the data. We demonstrate the scalability and efficiency of our framework using the Uintah and S3D large-scale combustion codes on the Mira and Edison supercomputers.
  • Keywords
    data structures; grid computing; input-output programs; parallel machines; AMR setting; AMR simulation; Edison supercomputer; I/O performance; Mira supercomputer; PIDX framework; S3D large-scale combustion code; Uintah; adaptive mesh refinement simulation; adaptive-resolution I/O framework; adaptive-resolution data; data resolution; disk usage; domain data; importance-driven storage; independent grid; lower resolution; multiresolution representation; regions of interest; resolution level; uniform grid; Adaptation models; Arrays; Data models; Encoding; Indexes; Layout; Spatial resolution;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    High Performance Computing, Networking, Storage and Analysis, SC14: International Conference for
  • Conference_Location
    New Orleans, LA
  • Print_ISBN
    978-1-4799-5499-5
  • Type

    conf

  • DOI
    10.1109/SC.2014.39
  • Filename
    7013021