DocumentCode :
1499964
Title :
Example-Based Automatic Music-Driven Conventional Dance Motion Synthesis
Author :
Fan, Rukun ; Xu, Songhua ; Geng, Weidong
Author_Institution :
Coll. of Comput. Sci., Zhejiang Univ. (Yuquan Campus), Hangzhou, China
Volume :
18
Issue :
3
fYear :
2012
fDate :
3/1/2012 12:00:00 AM
Firstpage :
501
Lastpage :
515
Abstract :
We introduce a novel method for synthesizing dance motions that follow the emotions and contents of a piece of music. Our method employs a learning-based approach to model the music to motion mapping relationship embodied in example dance motions along with those motions´ accompanying background music. A key step in our method is to train a music to motion matching quality rating function through learning the music to motion mapping relationship exhibited in synchronized music and dance motion data, which were captured from professional human dance performance. To generate an optimal sequence of dance motion segments to match with a piece of music, we introduce a constraint-based dynamic programming procedure. This procedure considers both music to motion matching quality and visual smoothness of a resultant dance motion sequence. We also introduce a two-way evaluation strategy, coupled with a GPU-based implementation, through which we can execute the dynamic programming process in parallel, resulting in significant speedup. To evaluate the effectiveness of our method, we quantitatively compare the dance motions synthesized by our method with motion synthesis results by several peer methods using the motions captured from professional human dancers´ performance as the gold standard. We also conducted several medium-scale user studies to explore how perceptually our dance motion synthesis method can outperform existing methods in synthesizing dance motions to match with a piece of music. These user studies produced very positive results on our music-driven dance motion synthesis experiments for several Asian dance genres, confirming the advantages of our method.
Keywords :
dynamic programming; graphics processing units; image matching; image motion analysis; image sequences; learning (artificial intelligence); music; Asian dance genres; GPU based implementation; constraint based dynamic programming; dance motion segments; example based automatic music driven conventional dance motion synthesis; learning based approach; motion mapping relationship; motion matching quality rating function; optimal sequence; peer method; professional human dance performance; resultant dance motion sequence; synchronized music; two-way evaluation strategy; visual smoothness; Correlation; Feature extraction; Humans; Joints; Motion segmentation; Synchronization; Training; Dance motion and music mapping relationship; learning-based dance motion synthesis.; music-driven dance motion synthesis; Analysis of Variance; Dancing; Emotions; Far East; Female; Humans; Image Processing, Computer-Assisted; Male; Music; Pattern Recognition, Automated; Reproducibility of Results; Video Recording; Young Adult;
fLanguage :
English
Journal_Title :
Visualization and Computer Graphics, IEEE Transactions on
Publisher :
ieee
ISSN :
1077-2626
Type :
jour
DOI :
10.1109/TVCG.2011.73
Filename :
5753889
Link To Document :
بازگشت