DocumentCode
3710363
Title
Architecture of geospatial big-data batch processing model based on Hadoop
Author
Sang-Su Kim;Sung-Hwan Yu
Author_Institution
IC Research Laboratory, ICTWAY Corporation, Dae-Jeon, Republic of Korea
fYear
2015
Firstpage
964
Lastpage
966
Abstract
In this paper, we propose a spatial ETL toolkit model, regardless of collectible data format, to replace traditional ETL (Extract, Transform, Load) to process public or individual system server with fast data creation. Recently various web servers, and the need of analyzing structured/unstructured Big-Data log information generated by independent high-speed servers are increasing. In addition, the space ETL model for replacing an existing service, which is built into a relational database is required and replaced the existing system in order to analyze unstructured data log information in Big-Data environments, where space is needed the ETL model. This paper proposes the spatial ETL model and proposed model is possible loading log information regardless of connected Hadoop or local storage to input data format quickly and accurately. Existing relational database consist of structured data is possible connection and extend function.
Keywords
"Load modeling","Data models","Storms","Data mining","Loading","XML","Engines"
Publisher
ieee
Conference_Titel
Information and Communication Technology Convergence (ICTC), 2015 International Conference on
Type
conf
DOI
10.1109/ICTC.2015.7354713
Filename
7354713
Link To Document