Title :
A novel method to manage very large raster data on distributed key-value storage system
Author :
Zhong, Yunqin ; Sun, Shangchun ; Liao, Haojun ; Zhao, Yanwei ; Fang, Jinyun
Abstract :
With the rapid development of information technologies and GIS techniques, raster data amount is growing on an unprecedented scale. Existing WebGIS based on local file systems and RDBMS cannot manage very large raster data efficiently because of limited storage capacity of single node. Although expensive storage devices are used to enlarge capacity, WebGIS is still vulnerable to suffer from single point of failure for its poor scalability. We propose a novel method to manage very large raster data, it has three characteristics. Firstly, raster data management system is built upon distributed key-value storage system instead of local file system and RDBMS, it has good scalability and high availability. Secondly, revised quadtree-based raster index is built in system to improve access efficiency. Thirdly, our prototype is transparent to WebGIS applications, and hence can integrate with existing applications seamlessly. The experimental results show that our method outperforms existing methods.
Keywords :
data handling; geographic information systems; information technology; tree data structures; GIS techniques; RDBMS; WebGIS; data management system; distributed key value storage system; distributed key-value storage system; information technologies development; quadtree based raster index; raster data; single node; storage capacity; storage devices; Data models; Distributed databases; Indexes; Memory; Throughput; Tiles; WebGIS; cloud storage; distributed key-value storage system; scalability; very large raster data management;
Conference_Titel :
Geoinformatics, 2011 19th International Conference on
Conference_Location :
Shanghai
Print_ISBN :
978-1-61284-849-5
DOI :
10.1109/GeoInformatics.2011.5980711