License: Creative Commons Attribution 3.0 Unported license (CC BY 3.0)
When quoting this document, please refer to the following
DOI: 10.4230/LIPIcs.ISAAC.2019.34
URN: urn:nbn:de:0030-drops-115302
URL: http://dagstuhl.sunsite.rwth-aachen.de/volltexte/2019/11530/
Go to the corresponding LIPIcs Volume Portal

Mazzetto, Alessio ; Pietracaprina, Andrea ; Pucci, Geppino

Accurate MapReduce Algorithms for k-Median and k-Means in General Metric Spaces

pdf-format:
LIPIcs-ISAAC-2019-34.pdf (0.5 MB)

Abstract

Center-based clustering is a fundamental primitive for data analysis and becomes very challenging for large datasets. In this paper, we focus on the popular k-median and k-means variants which, given a set P of points from a metric space and a parameter k<|P|, require to identify a set S of k centers minimizing, respectively, the sum of the distances and of the squared distances of all points in P from their closest centers. Our specific focus is on general metric spaces, for which it is reasonable to require that the centers belong to the input set (i.e., S subseteq P). We present coreset-based 3-round distributed approximation algorithms for the above problems using the MapReduce computational model. The algorithms are rather simple and obliviously adapt to the intrinsic complexity of the dataset, captured by the doubling dimension D of the metric space. Remarkably, the algorithms attain approximation ratios that can be made arbitrarily close to those achievable by the best known polynomial-time sequential approximations, and they are very space efficient for small D, requiring local memory sizes substantially sublinear in the input size. To the best of our knowledge, no previous distributed approaches were able to attain similar quality-performance guarantees in general metric spaces.

BibTeX - Entry

@InProceedings{mazzetto_et_al:LIPIcs:2019:11530,
  author =	{Alessio Mazzetto and Andrea Pietracaprina and Geppino Pucci},
  title =	{{Accurate MapReduce Algorithms for k-Median and k-Means in General Metric Spaces}},
  booktitle =	{30th International Symposium on Algorithms and Computation (ISAAC 2019)},
  pages =	{34:1--34:16},
  series =	{Leibniz International Proceedings in Informatics (LIPIcs)},
  ISBN =	{978-3-95977-130-6},
  ISSN =	{1868-8969},
  year =	{2019},
  volume =	{149},
  editor =	{Pinyan Lu and Guochuan Zhang},
  publisher =	{Schloss Dagstuhl--Leibniz-Zentrum fuer Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops.dagstuhl.de/opus/volltexte/2019/11530},
  URN =		{urn:nbn:de:0030-drops-115302},
  doi =		{10.4230/LIPIcs.ISAAC.2019.34},
  annote =	{Keywords: Clustering, k-median, k-means, MapReduce, Coreset}
}

Keywords: Clustering, k-median, k-means, MapReduce, Coreset
Collection: 30th International Symposium on Algorithms and Computation (ISAAC 2019)
Issue Date: 2019
Date of publication: 28.11.2019

DROPS-Home | Fulltext Search | Imprint | Privacy Published by LZI