DocumentCode :
652640
Title :
Lessons from Conducting a Distributed Quasi-experiment
Author :
Budgen, David ; Kitchenham, Barbara ; Charters, Stuart ; Gibbs, Shirley ; Pohthong, Amnart ; Keung, Jacky ; Brereton, P.
Author_Institution :
Sch. of Eng. & Comput. Sci., Durham Univ., Durham, UK
fYear :
2013
fDate :
10-11 Oct. 2013
Firstpage :
143
Lastpage :
152
Abstract :
Context: Due to the lack of suitably skilled participants, software engineering experiments often lack the statistical power needed to detect the levels of effect that may be encountered. Aim: To investigate whether this can be remedied by running an experiment across multiple sites, organised as a single study rather than as a set of replications. Method: We performed a `trial´ of the idea using a topic (structured abstracts) that some of us had studied previously and which required no participant training. We used five sites, each with 16 participants. Results: We were able to demonstrate the benefits of increased statistical power (and of structured abstracts). We report on our experiences with designing and conducting the study and identify some key lessons about how future studies of this form might be organised. Conclusions: The distributed model offers a flexible, robust form that is capable of delivering better statistical power than would be achieved by running a set of parallel replicated studies.
Keywords :
parallel processing; software engineering; statistical analysis; distributed model; distributed quasi-experiment; parallel replicated studies; software engineering experiments; statistical power; Abstracts; Data collection; Educational institutions; Electronic mail; Materials; Software; Software engineering; Documentation; Review and Evaluation; Software Engineering;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Empirical Software Engineering and Measurement, 2013 ACM / IEEE International Symposium on
Conference_Location :
Baltimore, MD
ISSN :
1938-6451
Print_ISBN :
978-0-7695-5056-5
Type :
conf
DOI :
10.1109/ESEM.2013.12
Filename :
6681347
Link To Document :
بازگشت