Title :
A Database for Reproducible Computational Research
Author :
Gomes, Gabriel F T ; Borin, Edson
Author_Institution :
Inst. de Comput., Univ. Estadual de Campinas, Campinas, Brazil
Abstract :
The ability to reproduce the experiments of a scientific research is one of the fundamental principles of the scientific method, as failing to reproduce it and obtain results equal (or very similar) to the original might imply that the later were wrong. In compiler and computer architecture research, reproducibility requires a researcher to be able to compile and execute software on (possibly many) computing systems in a repeatable manner. Though the source code for the studied applications, operating systems and compiler tool chains are often available, it is sometimes still impossible to exactly reproduce one experiment due to the lack of information about versioning of the code, build configuration and environmental setup. In this work we propose a database for gathering experimental setup information as well as related experimental results to enforce reproducibility and to enable results sharing among the researchers.
Keywords :
computer architecture; configuration management; database management systems; program compilers; programming environments; build configuration; code versioning; compiler research; compiler tool chain; computer architecture research; computing system; environmental setup; experimental setup information database; operating system; reproducible computational research database; scientific method; scientific research; software compilation; software execution; source code; Benchmark testing; Bioinformatics; Databases; Genomics; Hardware; Random access memory; Software; database; reproducibility; scientific method;
Conference_Titel :
Computer Systems (WSCAD-SSC), 2012 13th Symposium on
Conference_Location :
Petropolis
Print_ISBN :
978-1-4673-4468-5
DOI :
10.1109/WSCAD-SSC.2012.27