Sensing immersive 360° mobile interactive video

Video has the potential for a strong impact on viewers, their sense of presence and engagement, due to its immersive capacities. Multimedia sensing and the flexibility of mobility may be considered as options to further extend the video´s immersive capacities. Mobile devices are becoming ubiquitous and the range of sensors and actuators they incorporate is ever increasing, which creates the potential to capture and display 360º video and metadata and to support more powerful and immersive video user experiences. In this paper, we explore the immersion potential of mobile interactive video augmented with visual, auditory and tactile multisensing. User evaluation revealed advantages in using a multisensory approach to increase immersion and user satisfaction. Also, several properties and parameters that worked better in different conditions were identified, which may help to inform design of future mobile immersive video environments.