Title :
Comparison of two different similar speech and gestures multimodal interfaces
Author :
Karpov, Alexey ; Carbini, Sebastien ; Ronzhin, Andrey ; Viallet, Jean Emmanuel
Author_Institution :
SPIIRAS, St. Petersburg Inst. for Inf. & Autom., St. Petersburg, Russia
Abstract :
The paper presents two different multimodal interfaces based on automatic recognition and interpretation of speech and gestures of user´s head and hands, developed within the framework of the SIMILAR European Network of Excellence. The architectures of ICANDO and MOWGLI multimodal interfaces, modalities recognition, information synchronization and fusion as well as qualitative comparison and quantitative evaluation using Fitt´s law experiments are described. The comparison of both contactless interfaces shows that in spite of the differences in computer vision and ASR techniques applied, they provide similar performances in contactless human-computer interaction.
Keywords :
gesture recognition; human computer interaction; speech recognition; ASR technique; ICANDO multimodal interface; MOWGLI multimodal interface; computer vision; contactless human-computer interaction; gesture recognition; information fusion; information synchronization; modalities recognition; speech and gestures multimodal interfaces; speech recognition; Human computer interaction; Mice; Performance evaluation; Speech; Speech recognition; Synchronization; Tracking;
Conference_Titel :
Signal Processing Conference, 2008 16th European
Conference_Location :
Lausanne