Investigation into spatial audio quality of experience in the presence of accompanying video cues with spatial mismatch

This study investigates the metrics for spatial audio quality of experience (QoE) prediction, particularly considering the existence of video whose viewpoint may not match that of the auditory scene. Subjective tests were conducted for 5.1-channel audio quality evaluation following a previously developed testing and prediction methodology, with the addition of accompanying video cues and with the spatial correlation between audio and video as a new variable for the QoE prediction. The first experiment with a synthesized visual cue showed that the spatial mismatch between audio and video affects the perceived audio QoE. A prediction model of the QoE score was suggested through statistical analysis, using the audio-video angular mismatch as well as other known measurable low-level parameters. The model was validated through another set of subjective test using a captured real-life audiovisual content.