• DocumentCode
    1996898
  • Title

    MapReduce Algorithms for GIS Polygonal Overlay Processing

  • Author

    Puri, Shruti ; Agarwal, Deborah ; Xi He ; Prasad, Sushil K.

  • Author_Institution
    Dept. of Comput. Sci., Georgia State Univ., Atlanta, GA, USA
  • fYear
    2013
  • fDate
    20-24 May 2013
  • Firstpage
    1009
  • Lastpage
    1016
  • Abstract
    Polygon overlay is one of the complex operations in computational geometry. It is applied in many fields such as Geographic Information Systems (GIS), computer graphics and VLSI CAD. Sequential algorithms for this problem are in abundance in literature but there is a lack of distributed algorithms especially for MapReduce platform. In GIS, spatial data files tend to be large in size (in GBs) and the underlying overlay computation is highly irregular and compute intensive. The MapReduce paradigm is now standard in industry and academia for processing large-scale data. Motivated by the MapReduce programming model, we revisit the distributed polygon overlay problem and its implementation on MapReduce platform. Our algorithms are geared towards maximizing local processing and minimizing the communication overhead inherent with shuffle and sort phases in MapReduce. We have experimented with two data sets and achieved up to 22x speedup with dataset 1 using 64 CPU cores.
  • Keywords
    computational geometry; data handling; geographic information systems; parallel algorithms; CPU cores; GIS polygonal overlay processing; MapReduce algorithms; MapReduce platform; MapReduce programming model; Sequential algorithms; VLSI CAD; communication overhead minimization; computer graphics; distributed algorithms; distributed polygon overlay problem; geographic information systems; large-scale data processing; local processing maximization; shuffle phases; sort phases; spatial data files; Algorithm design and analysis; Data structures; Geographic information systems; Libraries; Partitioning algorithms; Spatial databases; Vectors; Cloud Computing; GIS; MapReduce; Polygon Overlay;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Parallel and Distributed Processing Symposium Workshops & PhD Forum (IPDPSW), 2013 IEEE 27th International
  • Conference_Location
    Cambridge, MA
  • Print_ISBN
    978-0-7695-4979-8
  • Type

    conf

  • DOI
    10.1109/IPDPSW.2013.254
  • Filename
    6650985