Title :
MapReduce Algorithms for GIS Polygonal Overlay Processing
Author :
Puri, Shruti ; Agarwal, Deborah ; Xi He ; Prasad, Sushil K.
Author_Institution :
Dept. of Comput. Sci., Georgia State Univ., Atlanta, GA, USA
Abstract :
Polygon overlay is one of the complex operations in computational geometry. It is applied in many fields such as Geographic Information Systems (GIS), computer graphics and VLSI CAD. Sequential algorithms for this problem are in abundance in literature but there is a lack of distributed algorithms especially for MapReduce platform. In GIS, spatial data files tend to be large in size (in GBs) and the underlying overlay computation is highly irregular and compute intensive. The MapReduce paradigm is now standard in industry and academia for processing large-scale data. Motivated by the MapReduce programming model, we revisit the distributed polygon overlay problem and its implementation on MapReduce platform. Our algorithms are geared towards maximizing local processing and minimizing the communication overhead inherent with shuffle and sort phases in MapReduce. We have experimented with two data sets and achieved up to 22x speedup with dataset 1 using 64 CPU cores.
Keywords :
computational geometry; data handling; geographic information systems; parallel algorithms; CPU cores; GIS polygonal overlay processing; MapReduce algorithms; MapReduce platform; MapReduce programming model; Sequential algorithms; VLSI CAD; communication overhead minimization; computer graphics; distributed algorithms; distributed polygon overlay problem; geographic information systems; large-scale data processing; local processing maximization; shuffle phases; sort phases; spatial data files; Algorithm design and analysis; Data structures; Geographic information systems; Libraries; Partitioning algorithms; Spatial databases; Vectors; Cloud Computing; GIS; MapReduce; Polygon Overlay;
Conference_Titel :
Parallel and Distributed Processing Symposium Workshops & PhD Forum (IPDPSW), 2013 IEEE 27th International
Conference_Location :
Cambridge, MA
Print_ISBN :
978-0-7695-4979-8
DOI :
10.1109/IPDPSW.2013.254