License: 
Creative Commons Attribution 3.0 Unported license (CC BY 3.0)
When quoting this document, please refer to the following
DOI: 10.4230/LIPIcs.ECOOP.2018.5
URN: urn:nbn:de:0030-drops-92105
URL: http://dagstuhl.sunsite.rwth-aachen.de/volltexte/2018/9210/
Lam, Wing ;
Srisakaokul, Siwakorn ;
Bassett, Blake ;
Mahdian, Peyman ;
Xie, Tao ;
Lakshman, Pratap ;
de Halleux, Jonathan
A Characteristic Study of Parameterized Unit Tests in .NET Open Source Projects
Abstract
In the past decade, parameterized unit testing has emerged as a promising method to specify program behaviors under test in the form of unit tests. Developers can write parameterized unit tests (PUTs), unit-test methods with parameters, in contrast to conventional unit tests, without parameters. The use of PUTs can enable powerful test generation tools such as Pex to have strong test oracles to check against, beyond just uncaught runtime exceptions. In addition, PUTs have been popularly supported by various unit testing frameworks for .NET and the JUnit framework for Java. However, there exists no study to offer insights on how PUTs are written by developers in either proprietary or open source development practices, posing barriers for various stakeholders to bring PUTs to widely adopted practices in software industry. To fill this gap, we first present categorization results of the Microsoft MSDN Pex Forum posts (contributed primarily by industrial practitioners) related to PUTs. We then use the categorization results to guide the design of the first characteristic study of PUTs in .NET open source projects. We study hundreds of PUTs that open source developers wrote for these open source projects. Our study findings provide valuable insights for various stakeholders such as current or prospective PUT writers (e.g., developers), PUT framework designers, test-generation tool vendors, testing researchers, and testing educators.
BibTeX - Entry
@InProceedings{lam_et_al:LIPIcs:2018:9210,
author = {Wing Lam and Siwakorn Srisakaokul and Blake Bassett and Peyman Mahdian and Tao Xie and Pratap Lakshman and Jonathan de Halleux},
title = {{A Characteristic Study of Parameterized Unit Tests in .NET Open Source Projects}},
booktitle = {32nd European Conference on Object-Oriented Programming (ECOOP 2018)},
pages = {5:1--5:27},
series = {Leibniz International Proceedings in Informatics (LIPIcs)},
ISBN = {978-3-95977-079-8},
ISSN = {1868-8969},
year = {2018},
volume = {109},
editor = {Todd Millstein},
publisher = {Schloss Dagstuhl--Leibniz-Zentrum fuer Informatik},
address = {Dagstuhl, Germany},
URL = {http://drops.dagstuhl.de/opus/volltexte/2018/9210},
URN = {urn:nbn:de:0030-drops-92105},
doi = {10.4230/LIPIcs.ECOOP.2018.5},
annote = {Keywords: Parameterized unit testing, automated test generation, unit testing}
}
|
Keywords: |
|
Parameterized unit testing, automated test generation, unit testing |
|
Collection: |
|
32nd European Conference on Object-Oriented Programming (ECOOP 2018) |
|
Issue Date: |
|
2018 |
|
Date of publication: |
|
10.07.2018 |
