License: Creative Commons Attribution 3.0 Unported license (CC BY 3.0)
When quoting this document, please refer to the following
DOI: 10.4230/OASIcs.SCOR.2016.6
URN: urn:nbn:de:0030-drops-65184
URL: http://dagstuhl.sunsite.rwth-aachen.de/volltexte/2016/6518/
Go to the corresponding OASIcs Volume Portal


Tsioptsias, Naoum ; Tako, Antuela ; Robinson, Stewart

Model Validation and Testing in Simulation: a Literature Review

pdf-format:
OASIcs-SCOR-2016-6.pdf (0.4 MB)


Abstract

Model validation is a key activity undertaken during the model development process in simulation. There is a large body of literature on model validation, albeit there exists little convergence in terms of the definitions, types of validity, and tests used. Yet it is not clear what standards should be taken into consideration to avoid developing what could be considered to be invalid or wrong models. In this paper we examine existing literature on model validation with the view to identifying the existing validation approaches and types of tests used to assess model validity. In this review we focus our attention on three domains that usually overlap in methods and techniques: general Operational Research (OR), Modelling & Simulation (M&S) and Computer Science (CS). We analyze each field to identify the aspects of validity considered including the tests used, the validation approach taken, i.e. the suggested level of validity achieved (if this applies) and the reported outcome. The analysis shows that there are common validation practices used in all three fields as well as new ideas that could be adopted in discrete event simulation. Some main points of concurrence include the lack of universal validation, the continuous need for validation, and, the indispensable need for modelers and users to work closely together during the model validation process. This review provides an initial categorization of literature on model validation which can in turn be used as a basis for future work in investigating how and to what extent models are considered sufficiently valid.

BibTeX - Entry

@InProceedings{tsioptsias_et_al:OASIcs:2016:6518,
  author =	{Naoum Tsioptsias and Antuela Tako and Stewart Robinson},
  title =	{{Model Validation and Testing in Simulation: a Literature Review}},
  booktitle =	{5th Student Conference on Operational Research (SCOR 2016)},
  pages =	{6:1--6:11},
  series =	{OpenAccess Series in Informatics (OASIcs)},
  ISBN =	{978-3-95977-004-0},
  ISSN =	{2190-6807},
  year =	{2016},
  volume =	{50},
  editor =	{Bradley Hardy and Abroon Qazi and Stefan Ravizza},
  publisher =	{Schloss Dagstuhl--Leibniz-Zentrum fuer Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{http://drops.dagstuhl.de/opus/volltexte/2016/6518},
  URN =		{urn:nbn:de:0030-drops-65184},
  doi =		{10.4230/OASIcs.SCOR.2016.6},
  annote =	{Keywords: Validation, Simulation, Literature review, Types of validity, Field Comparisons}
}

Keywords: Validation, Simulation, Literature review, Types of validity, Field Comparisons
Collection: 5th Student Conference on Operational Research (SCOR 2016)
Issue Date: 2016
Date of publication: 23.08.2016


DROPS-Home | Fulltext Search | Imprint | Privacy Published by LZI