• DocumentCode
    699817
  • Title

    Comparison of two different similar speech and gestures multimodal interfaces

  • Author

    Karpov, Alexey ; Carbini, Sebastien ; Ronzhin, Andrey ; Viallet, Jean Emmanuel

  • Author_Institution
    SPIIRAS, St. Petersburg Inst. for Inf. & Autom., St. Petersburg, Russia
  • fYear
    2008
  • fDate
    25-29 Aug. 2008
  • Firstpage
    1
  • Lastpage
    5
  • Abstract
    The paper presents two different multimodal interfaces based on automatic recognition and interpretation of speech and gestures of user´s head and hands, developed within the framework of the SIMILAR European Network of Excellence. The architectures of ICANDO and MOWGLI multimodal interfaces, modalities recognition, information synchronization and fusion as well as qualitative comparison and quantitative evaluation using Fitt´s law experiments are described. The comparison of both contactless interfaces shows that in spite of the differences in computer vision and ASR techniques applied, they provide similar performances in contactless human-computer interaction.
  • Keywords
    gesture recognition; human computer interaction; speech recognition; ASR technique; ICANDO multimodal interface; MOWGLI multimodal interface; computer vision; contactless human-computer interaction; gesture recognition; information fusion; information synchronization; modalities recognition; speech and gestures multimodal interfaces; speech recognition; Human computer interaction; Mice; Performance evaluation; Speech; Speech recognition; Synchronization; Tracking;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Signal Processing Conference, 2008 16th European
  • Conference_Location
    Lausanne
  • ISSN
    2219-5491
  • Type

    conf

  • Filename
    7080349