Title :
Sensor fusion: Towards a fully expressive 3D music control interface
Author :
Odowichuk, Gabrielle ; Trail, Shawn ; Driessen, Peter ; Nie, Wendy ; Page, Wyatt
Author_Institution :
Dept. of Electr. & Comput. Eng., Univ. of Victoria, Victoria, BC, Canada
Abstract :
This paper describes a study into the realisation of a new method for capturing 3D sound control data. It expands on our established practice with the radiodrum 3D input device by incorporating a computer vision platform that we have developed using the Xbox Kinect motion sensing input device. It also extends our previous work in systemizing a low-cost, open-source 3D gesture sensor system, as a novel method for musically oriented human computer interaction. We discuss in detail the development process and the system performance in different scenarios and outline the future directions of this development.
Keywords :
computer vision; gesture recognition; human computer interaction; music; musical instruments; sensor fusion; 3D music control interface; Xbox Kinect motion sensing input device; computer vision platform; musically oriented human computer interaction; open-source 3D gesture sensor system; radiodrum 3D input device; sensor fusion; Biological system modeling; Computers; Data models; Instruments; Music; Three dimensional displays;
Conference_Titel :
Communications, Computers and Signal Processing (PacRim), 2011 IEEE Pacific Rim Conference on
Conference_Location :
Victoria, BC
Print_ISBN :
978-1-4577-0252-5
Electronic_ISBN :
1555-5798
DOI :
10.1109/PACRIM.2011.6033003
