Title :
Massive image data management using HBase and MapReduce
Author :
Yuehu Liu ; Bin Chen ; Wenxi He ; Yu Fang
Author_Institution :
Inst. of Remote Sensing & Geographic Inf. Syst., Peking Univ., Beijing, China
Abstract :
With the rapid development of remote sensing and computer technologies, remote sensing image data obtained by satellite isincreasing dramatically [1]. The speed has exceeded one TB each day and will obviously increase in the future. How to manage it efficiently becomes a problem because traditional waysare expensive and difficultto extend. Hence, we need a scalable and parallel processing model. HBaseand MapReduce meet the needs naturally. In this paper, we propose a method to store massive image data in HBase, and process it using MapReduce. Experimental results illustrate that the speeds of data importing and data processing increase obviously as the cluster of HBase grows.
Keywords :
geophysical image processing; parallel processing; remote sensing; HBase; MapReduce; computer technologies; massive image data management; massive image data storage; parallel processing model; remote sensing image data; scalable model; Computational modeling; Computers; Data models; Distributed databases; Programming; Remote sensing; HBase; Hadoop; MapReduce; image management; massive;
Conference_Titel :
Geoinformatics (GEOINFORMATICS), 2013 21st International Conference on
Conference_Location :
Kaifeng
DOI :
10.1109/Geoinformatics.2013.6626187