License: Creative Commons Attribution 3.0 Unported license (CC BY 3.0)
When quoting this document, please refer to the following
DOI: 10.4230/LIPIcs.ESA.2019.41
URN: urn:nbn:de:0030-drops-111624
URL: http://dagstuhl.sunsite.rwth-aachen.de/volltexte/2019/11162/
Go to the corresponding LIPIcs Volume Portal

Dinklage, Patrick ; Ellert, Jonas ; Fischer, Johannes ; Köppl, Dominik ; Penschuck, Manuel

Bidirectional Text Compression in External Memory

pdf-format:
LIPIcs-ESA-2019-41.pdf (0.8 MB)

Abstract

Bidirectional compression algorithms work by substituting repeated substrings by references that, unlike in the famous LZ77-scheme, can point to either direction. We present such an algorithm that is particularly suited for an external memory implementation. We evaluate it experimentally on large data sets of size up to 128 GiB (using only 16 GiB of RAM) and show that it is significantly faster than all known LZ77 compressors, while producing a roughly similar number of factors. We also introduce an external memory decompressor for texts compressed with any uni- or bidirectional compression scheme.

BibTeX - Entry

@InProceedings{dinklage_et_al:LIPIcs:2019:11162,
  author =	{Patrick Dinklage and Jonas Ellert and Johannes Fischer and Dominik K{\"o}ppl and Manuel Penschuck},
  title =	{{Bidirectional Text Compression in External Memory}},
  booktitle =	{27th Annual European Symposium on Algorithms (ESA 2019)},
  pages =	{41:1--41:16},
  series =	{Leibniz International Proceedings in Informatics (LIPIcs)},
  ISBN =	{978-3-95977-124-5},
  ISSN =	{1868-8969},
  year =	{2019},
  volume =	{144},
  editor =	{Michael A. Bender and Ola Svensson and Grzegorz Herman},
  publisher =	{Schloss Dagstuhl--Leibniz-Zentrum fuer Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{http://drops.dagstuhl.de/opus/volltexte/2019/11162},
  URN =		{urn:nbn:de:0030-drops-111624},
  doi =		{10.4230/LIPIcs.ESA.2019.41},
  annote =	{Keywords: text compression, bidirectional parsing, text decompression, external algorithms}
}

Keywords: text compression, bidirectional parsing, text decompression, external algorithms
Collection: 27th Annual European Symposium on Algorithms (ESA 2019)
Issue Date: 2019
Date of publication: 06.09.2019

DROPS-Home | Fulltext Search | Imprint | Privacy Published by LZI