Title :
Visual Rhythm Detection and Its Applications in Interactive Multimedia
Author :
Chen, Trista P. ; Chen, Ching-Wei ; Popp, Phillip ; Coover, Bob
Abstract :
True multimedia experience involves multimodal media and their intrinsic interactions. This article identifies rhythm as the link between physical movement, other visual stimuli, and the musical art form. It describes two example interactive multimedia applications in which visual rhythm is extracted for synchronization of music and video to allow more intuitive interaction between a user and both audio and video content, leaving the door open for many potential innovative applications.
Keywords :
interactive systems; multimedia systems; music; video signal processing; interactive multimedia; multimodal media; music synchronization; musical art form; video synchronization; visual rhythm detection; visual stimuli; Computer vision; Feature extraction; Image motion analysis; Interactive systems; Multimedia communication; Rhythm; Videos; Visualization; beat detection; novelty detection; time stretching; visual rhythm; visual tempo;
Journal_Title :
MultiMedia, IEEE
DOI :
10.1109/MMUL.2011.19
