License: Creative Commons Attribution 4.0 International license (CC BY 4.0)
When quoting this document, please refer to the following
DOI: 10.4230/LIPIcs.ECOOP.2021.6
URN: urn:nbn:de:0030-drops-140498
URL: http://dagstuhl.sunsite.rwth-aachen.de/volltexte/2021/14049/
Maj, Petr ;
Siek, Konrad ;
Kovalenko, Alexander ;
Vitek, Jan
CodeDJ: Reproducible Queries over Large-Scale Software Repositories
Abstract
Analyzing massive code bases is a staple of modern software engineering research – a welcome side-effect of the advent of large-scale software repositories such as GitHub. Selecting which projects one should analyze is a labor-intensive process, and a process that can lead to biased results if the selection is not representative of the population of interest. One issue faced by researchers is that the interface exposed by software repositories only allows the most basic of queries. CodeDJ is an infrastructure for querying repositories composed of a persistent datastore, constantly updated with data acquired from GitHub, and an in-memory database with a Rust query interface. CodeDJ supports reproducibility, historical queries are answered deterministically using past states of the datastore; thus researchers can reproduce published results. To illustrate the benefits of CodeDJ, we identify biases in the data of a published study and, by repeating the analysis with new data, we demonstrate that the study’s conclusions were sensitive to the choice of projects.
BibTeX - Entry
@InProceedings{maj_et_al:LIPIcs.ECOOP.2021.6,
author = {Maj, Petr and Siek, Konrad and Kovalenko, Alexander and Vitek, Jan},
title = {{CodeDJ: Reproducible Queries over Large-Scale Software Repositories}},
booktitle = {35th European Conference on Object-Oriented Programming (ECOOP 2021)},
pages = {6:1--6:24},
series = {Leibniz International Proceedings in Informatics (LIPIcs)},
ISBN = {978-3-95977-190-0},
ISSN = {1868-8969},
year = {2021},
volume = {194},
editor = {M{\o}ller, Anders and Sridharan, Manu},
publisher = {Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
address = {Dagstuhl, Germany},
URL = {https://drops.dagstuhl.de/opus/volltexte/2021/14049},
URN = {urn:nbn:de:0030-drops-140498},
doi = {10.4230/LIPIcs.ECOOP.2021.6},
annote = {Keywords: Software, Mining Code Repositories, Source Code Analysis}
}
Keywords: |
|
Software, Mining Code Repositories, Source Code Analysis |
Collection: |
|
35th European Conference on Object-Oriented Programming (ECOOP 2021) |
Issue Date: |
|
2021 |
Date of publication: |
|
06.07.2021 |
Supplementary Material: |
|
Software (ECOOP 2021 Artifact Evaluation approved artifact): https://doi.org/10.4230/DARTS.7.2.13 |