Coordinated Visualisation of Video and System Log Data

As mobile computing technologies become common, there is an ever-greater interest in evaluation and analysis of such systems. Evaluating the use of large, multi-user, mobile systems can be a challenging task and can be aided by analysing both system-generated logs of activity and video of user behaviour. Replayer provides a distributed, cross platform toolkit for utilising multiple coordinated visualisations in the analysis and understanding of these heterogeneous forms of data. In this paper we pay particular attention to the methods used to combine recorded media such as video with numerical visualisations such as histograms and time series graphs. We examine in some detail the architecture behind the system, and the techniques used to maintain synchronisation and coordination when interactively brushing components. We demonstrate how Replayer can be used to explore data sets using an array of available visualisations, can focus analysis of video data on the most salient periods and can provide context for every area of the recorded data