DocumentCode :
3243743
Title :
Multimodal natural user interaction for multiple applications: The gesture — Voice example
Author :
Vidakis, N. ; Syntychakis, M. ; Triantafyllidis, G. ; Akoumianakis, D.
Author_Institution :
Appl. Inf. & Multimedia, Technol. Educ. Inst. of Crete, Heraklion, Greece
fYear :
2012
fDate :
July 30 2012-Aug. 1 2012
Firstpage :
208
Lastpage :
213
Abstract :
In this paper we present a natural user interface system. The device utilized for achieving natural interaction is the MS-Kinect which provides RGB, depth & audio signal. Our system is based on the theory of multimodal interaction and provides the ability to the user to interact simultaneously with different applications using vocal commands and gesture in conjunction. The difference of our system from other similar efforts is that it uses a multimodal interaction approach to manipulate multi-applications by employing a generic container, which runs at the background and serves as an intermediate between multimodal input and active applications running on a computer. We describe the architecture of the system based on multimodal interaction and its representative example using two PC applications.
Keywords :
audio signals; human computer interaction; speech processing; MS-Kinect; PC applications; RGB; audio signal; gesture-voice example; human-computer interaction; multimodal natural user interaction system; vocal commands; Computer architecture; Computers; Context; Databases; Flowcharts; Manipulators; Syntactics; MS-Kinect; Multi-Application Interaction; Multimodal Interaction;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Telecommunications and Multimedia (TEMU), 2012 International Conference on
Conference_Location :
Chania
Print_ISBN :
978-1-4673-2780-0
Electronic_ISBN :
978-1-4673-2779-4
Type :
conf
DOI :
10.1109/TEMU.2012.6294720
Filename :
6294720
Link To Document :
بازگشت