Supporting experimental collaborative systems evaluation

This paper proposes a framework and tool for conducting laboratory experiments with collaborative systems. The framework and tool seek to control a large number of experimental conditions, while obtaining fine-grained log data about the individual and collaborative activities. Furthermore, the proposed framework and tool allow reusing voice communication and questionnaire modules. The paper also reports a laboratory experiment where the framework and tool were used to analyze the impact of collaboration support on teams performing maintenance activities on a network infrastructure. The obtained results highlight the capacity of the framework and tool to facilitate collaborative systems evaluation.