A multimodal architecture for home control by disabled users

This paper describes the architecture of MIMUS, a multimodal, multilingual interaction system which allows users to control the devices in their houses, interacting by voice and clicks. MIMUS design relies on Wizard of Oz experiments and is targeted at disabled users in the in-home scenario. MIMUS consists of a set of OAA collaborative agents with a clear distinction between knowledge resources, dialogue management and domain specific functionalities. The MIMUS system includes contributions to the scientific community in multimodal fusion, knowledge management and presentation strategies.