DocumentCode :
77153
Title :
Dynamic Time Warping for Music Conducting Gestures Evaluation
Author :
Schramm, Rodrigo ; Rosito Jung, Claudio ; Reck Miranda, Eduardo
Author_Institution :
Inst. of Inf., Univ. Fed. do Rio Grande do Sul, Porto Alegre, Brazil
Volume :
17
Issue :
2
fYear :
2015
fDate :
Feb. 2015
Firstpage :
243
Lastpage :
255
Abstract :
Musical performance by an ensemble of performers often requires a conductor. This paper presents a tool to aid the study of basic conducting gestures, also known as meter- mimicking gestures, performed by beginners. It is based on the automatic detection of musical metrics and their subdivisions by analysis of hand gestures. Musical metrics are represented by visual conducting patterns performed by hands, which are tracked using an RGB-D camera. These patterns are recognized and evaluated using a probabilistic framework based on dynamic time warping (DTW). There are two main contributions in this work. Firstly, a new metric is proposed for the DTW, allowing better alignment between two gesture movements without the use of explicit maxima local points. Secondly, the time precision of the conducting gesture is extracted directly from the warping path and its accuracy is evaluated by a confidence measure. Experimental results indicate that the classification scheme represents an improvement over other existing related approaches.
Keywords :
gesture recognition; image classification; image colour analysis; music; probability; DTW; RGB-D camera; automatic detection; classification scheme; confidence measure; dynamic time warping; gesture movement; hand gesture; maxima local point; meter-mimicking gesture; music conducting gestures evaluation; musical metrics; musical performance; pattern recognition; probabilistic framework; visual conducting pattern; Cameras; Conductors; Magnetic sensors; Position measurement; Tracking; Distance learning; dynamic time warping (DTW); meter-mimicking; musical conducting; pattern recognition;
fLanguage :
English
Journal_Title :
Multimedia, IEEE Transactions on
Publisher :
ieee
ISSN :
1520-9210
Type :
jour
DOI :
10.1109/TMM.2014.2377553
Filename :
6975197
Link To Document :
بازگشت