• DocumentCode
    2706208
  • Title

    A novel method to manage very large raster data on distributed key-value storage system

  • Author

    Zhong, Yunqin ; Sun, Shangchun ; Liao, Haojun ; Zhao, Yanwei ; Fang, Jinyun

  • fYear
    2011
  • fDate
    24-26 June 2011
  • Firstpage
    1
  • Lastpage
    6
  • Abstract
    With the rapid development of information technologies and GIS techniques, raster data amount is growing on an unprecedented scale. Existing WebGIS based on local file systems and RDBMS cannot manage very large raster data efficiently because of limited storage capacity of single node. Although expensive storage devices are used to enlarge capacity, WebGIS is still vulnerable to suffer from single point of failure for its poor scalability. We propose a novel method to manage very large raster data, it has three characteristics. Firstly, raster data management system is built upon distributed key-value storage system instead of local file system and RDBMS, it has good scalability and high availability. Secondly, revised quadtree-based raster index is built in system to improve access efficiency. Thirdly, our prototype is transparent to WebGIS applications, and hence can integrate with existing applications seamlessly. The experimental results show that our method outperforms existing methods.
  • Keywords
    data handling; geographic information systems; information technology; tree data structures; GIS techniques; RDBMS; WebGIS; data management system; distributed key value storage system; distributed key-value storage system; information technologies development; quadtree based raster index; raster data; single node; storage capacity; storage devices; Data models; Distributed databases; Indexes; Memory; Throughput; Tiles; WebGIS; cloud storage; distributed key-value storage system; scalability; very large raster data management;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Geoinformatics, 2011 19th International Conference on
  • Conference_Location
    Shanghai
  • ISSN
    2161-024X
  • Print_ISBN
    978-1-61284-849-5
  • Type

    conf

  • DOI
    10.1109/GeoInformatics.2011.5980711
  • Filename
    5980711