License: Creative Commons Attribution 3.0 Unported license (CC BY 3.0)
When quoting this document, please refer to the following
DOI: 10.4230/LIPIcs.GISCIENCE.2018.2
URN: urn:nbn:de:0030-drops-93306
URL: http://dagstuhl.sunsite.rwth-aachen.de/volltexte/2018/9330/
Go to the corresponding LIPIcs Volume Portal

Belussi, Alberto ; Carra, Damiano ; Migliorini, Sara ; Negri, Mauro ; Pelagatti, Giuseppe

What Makes Spatial Data Big? A Discussion on How to Partition Spatial Data

pdf-format:
LIPIcs-GISCIENCE-2018-2.pdf (0.5 MB)

Abstract

The amount of available spatial data has significantly increased in the last years so that traditional analysis tools have become inappropriate to effectively manage them. Therefore, many attempts have been made in order to define extensions of existing MapReduce tools, such as Hadoop or Spark, with spatial capabilities in terms of data types and algorithms. Such extensions are mainly based on the partitioning techniques implemented for textual data where the dimension is given in terms of the number of occupied bytes. However, spatial data are characterized by other features which describe their dimension, such as the number of vertices or the MBR size of geometries, which greatly affect the performance of operations, like the spatial join, during data analysis. The result is that the use of traditional partitioning techniques prevents to completely exploit the benefit of the parallel execution provided by a MapReduce environment. This paper extensively analyses the problem considering the spatial join operation as use case, performing both a theoretical and an experimental analysis for it. Moreover, it provides a solution based on a different partitioning technique, which splits complex or extensive geometries. Finally, we validate the proposed solution by means of some experiments on synthetic and real datasets.

BibTeX - Entry

@InProceedings{belussi_et_al:LIPIcs:2018:9330,
  author =	{Alberto Belussi and Damiano Carra and Sara Migliorini and Mauro Negri and Giuseppe Pelagatti},
  title =	{{What Makes Spatial Data Bigl A Discussion on How to Partition Spatial Data}},
  booktitle =	{10th International Conference on Geographic Information  Science (GIScience 2018)},
  pages =	{2:1--2:15},
  series =	{Leibniz International Proceedings in Informatics (LIPIcs)},
  ISBN =	{978-3-95977-083-5},
  ISSN =	{1868-8969},
  year =	{2018},
  volume =	{114},
  editor =	{Stephan Winter and Amy Griffin and Monika Sester},
  publisher =	{Schloss Dagstuhl--Leibniz-Zentrum fuer Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{http://drops.dagstuhl.de/opus/volltexte/2018/9330},
  URN =		{urn:nbn:de:0030-drops-93306},
  doi =		{10.4230/LIPIcs.GISCIENCE.2018.2},
  annote =	{Keywords: Spatial join, SpatialHadoop, MapReduce, partitioning, big data}
}

Keywords: Spatial join, SpatialHadoop, MapReduce, partitioning, big data
Collection: 10th International Conference on Geographic Information Science (GIScience 2018)
Issue Date: 2018
Date of publication: 02.08.2018

DROPS-Home | Fulltext Search | Imprint | Privacy Published by LZI