License: Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported license (CC BY-NC-ND 3.0)
When quoting this document, please refer to the following
DOI: 10.4230/OASIcs.WCET.2010.136
URN: urn:nbn:de:0030-drops-28336
URL: http://dagstuhl.sunsite.rwth-aachen.de/volltexte/2010/2833/
Go to the corresponding OASIcs Volume Portal

Gustafsson, Jan ; Betts, Adam ; Ermedahl, Andreas ; Lisper, Björn

The Mälardalen WCET Benchmarks: Past, Present And Future

pdf-format:
15.pdf (0.4 MB)

Abstract

Modelling of real-time systems requires accurate and tight estimates of the Worst-Case Execution Time (WCET) of each task scheduled to run. In the past two decades, two main paradigms have emerged within the field of WCET analysis: static analysis and hybrid measurement-based analysis. These techniques have been succesfully implemented in prototype and commercial toolsets. Yet, comparison among the WCET estimates derived by such tools remains somewhat elusive as it requires a common set of benchmarks which serve a multitude of needs.

The Maelardalen WCET research group maintains a large number of WCET benchmark programs for this purpose. This paper describes properties of the existing benchmarks, including their relative strengths and weaknesses. We propose extensions to the benchmarks which will allow any type of WCET tool evaluate its results against other state-of-the-art tools, thus setting a high standard for future research and development.

We also propose an organization supporting the future work with the benchmarks. We suggest to form a committee with a responsibility for the benchmarks, and that the benchmark web site is transformed to an open wiki, with possibility for the WCET community to easily update the benchmarks.

BibTeX - Entry

@InProceedings{gustafsson_et_al:OASIcs:2010:2833,
  author =	{Jan Gustafsson and Adam Betts and Andreas Ermedahl and Bj{\"o}rn Lisper},
  title =	{{The M{\"a}lardalen WCET Benchmarks: Past, Present And Future}},
  booktitle =	{10th International Workshop on Worst-Case Execution Time Analysis (WCET 2010)},
  pages =	{136--146},
  series =	{OpenAccess Series in Informatics (OASIcs)},
  ISBN =	{978-3-939897-21-7},
  ISSN =	{2190-6807},
  year =	{2010},
  volume =	{15},
  editor =	{Bj{\"o}rn Lisper},
  publisher =	{Schloss Dagstuhl--Leibniz-Zentrum fuer Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{http://drops.dagstuhl.de/opus/volltexte/2010/2833},
  URN =		{urn:nbn:de:0030-drops-28336},
  doi =		{10.4230/OASIcs.WCET.2010.136},
  note =	{The printed version of the WCET'10 proceedings are published by OCG (www.ocg.at) - ISBN 978-3-85403-268-7},
  annote =	{Keywords: WCET analysis, benchmark}
}

Keywords: WCET analysis, benchmark
Collection: 10th International Workshop on Worst-Case Execution Time Analysis (WCET 2010)
Issue Date: 2010
Date of publication: 26.11.2010

DROPS-Home | Fulltext Search | Imprint | Privacy Published by LZI