This is the artifact for the paper "Causal Testing: Understanding Defects' Root Causes". This artifact replicates the user study setup used to evaluate our technique, including the supplementary data collection materials.
Our artifact includes the following:
-
A virtual machine file (CausalTesting_Artifact.ova) that contains the user study setup and version of Holmes used.
-
The form participants completed as they worked through each defect in the user study (Cause-Identification-Form.pdf).
-
The post-questionnaire participants filled out as a form of debriefing following the study (Evaluation-Questionnaire.pdf)
-
The demographic questionnaire used to gather information about our participants background and experience (Demographic-Questionnaire.pdf).
-
The script used to explain to participants what they would be doing during the user study (User-Study-Script.pdf).
All the above listed artifacts, with the exception of the virtual machine file, are located in this repository.
The INSTALL.md file provides details on how to locate, set up, and run the virutal machine.