• DocumentCode
    3532940
  • Title

    A new framework of cluster-based parallel processing system for high-performance geo-computing

  • Author

    Ma, Yan ; Liu, Dingsheng ; Li, Jingshan

  • Author_Institution
    Center for Earth Obs. & Digital Earth, Chinese Acad. of Sci.(CAS), Beijing, China
  • Volume
    4
  • fYear
    2009
  • fDate
    12-17 July 2009
  • Abstract
    Up to now, it still remains a big challenge for us to build a high performance geo-computing system with high processing speed and also be easy of use by domain researchers. The unprecedented scale data and various complex algorithms pose many computational and management challenges. To properly settle these main issues above, a new system framework for high performance geo-computing is presented in this paper. A High Performance Geo-data Object Storage System (HPGOSS) base on parallel file System is used for eliminating I/O performance bottleneck and deal with the data managing problem result from the close relevancy between geo-information and remote sensing image data. Parallel programming models for fast parallelization of geo-computing algorithms are proposed. In addition, the job scheduling strategy and workflow engine are also discussed. Finally, such system could provide a parallel geo-computing environment with high performance, easy to use, optimal resource utilization, and high scalability.
  • Keywords
    geographic information systems; object-oriented databases; parallel programming; pattern clustering; cluster based parallel processing system; data managing problem; geo-information data; geocomputing system; high performance geodata object storage system; job scheduling strategy; optimal resource utilization; parallel file system; parallel programming model; remote sensing image data; workflow engine; Clustering algorithms; Concurrent computing; File systems; Geoscience; Image storage; Large-scale systems; Parallel processing; Parallel programming; Processor scheduling; Remote sensing; geo-computing; high-performance computing; parallel file system; parallel programming model; remote sensing image processing; system framework;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Geoscience and Remote Sensing Symposium,2009 IEEE International,IGARSS 2009
  • Conference_Location
    Cape Town
  • Print_ISBN
    978-1-4244-3394-0
  • Electronic_ISBN
    978-1-4244-3395-7
  • Type

    conf

  • DOI
    10.1109/IGARSS.2009.5417598
  • Filename
    5417598