DocumentCode
699817
Title
Comparison of two different similar speech and gestures multimodal interfaces
Author
Karpov, Alexey ; Carbini, Sebastien ; Ronzhin, Andrey ; Viallet, Jean Emmanuel
Author_Institution
SPIIRAS, St. Petersburg Inst. for Inf. & Autom., St. Petersburg, Russia
fYear
2008
fDate
25-29 Aug. 2008
Firstpage
1
Lastpage
5
Abstract
The paper presents two different multimodal interfaces based on automatic recognition and interpretation of speech and gestures of user´s head and hands, developed within the framework of the SIMILAR European Network of Excellence. The architectures of ICANDO and MOWGLI multimodal interfaces, modalities recognition, information synchronization and fusion as well as qualitative comparison and quantitative evaluation using Fitt´s law experiments are described. The comparison of both contactless interfaces shows that in spite of the differences in computer vision and ASR techniques applied, they provide similar performances in contactless human-computer interaction.
Keywords
gesture recognition; human computer interaction; speech recognition; ASR technique; ICANDO multimodal interface; MOWGLI multimodal interface; computer vision; contactless human-computer interaction; gesture recognition; information fusion; information synchronization; modalities recognition; speech and gestures multimodal interfaces; speech recognition; Human computer interaction; Mice; Performance evaluation; Speech; Speech recognition; Synchronization; Tracking;
fLanguage
English
Publisher
ieee
Conference_Titel
Signal Processing Conference, 2008 16th European
Conference_Location
Lausanne
ISSN
2219-5491
Type
conf
Filename
7080349
Link To Document