Title :
Multi-modal output composition for human-computer dialogues
Author :
Neal, Jeannette G. ; Thielman, Carol Y. ; Funke, Douglas J. ; Byoun, Jung S.
Author_Institution :
Calspan-UB Res. Center, Buffalo, NY, USA
Abstract :
The authors discuss the development of a prototype multimodal human-computer interface system, called CUBRICON, which is a research platform for investigating how knowledge-based approaches can best be applied to enhance human-computer interfaces. Four critical features of such an interface are introduced along with CUBRICON´s initial approach to achieving them. Several knowledge sources have been defined within CUBRICON. These serve as the basis for CUBRICON´s multimedia output planning process. These knowledge sources include: characteristics of the information, a model of the ongoing discourse, a user/task model, and a knowledge base of task domain and related interface information. CUBRICON´s output planning process includes selection of appropriate media/modalities, selection of ancillary relevant information, determination of whether display resources are available, modification of resources or information to be expressed (if necessary), modification of selected output media/modalities (if necessary), and composition of the output. Examples are given for the application task domain of military tactical air control
Keywords :
knowledge based systems; military computing; natural languages; user interfaces; CUBRICON; computer graphics; context dependence; human-computer dialogues; knowledge base; knowledge sources; military tactical air control; multimedia output planning process; ongoing discourse; prototype multimodal human-computer interface system; speech recognition; speech synthesis; task domain; user/task model; voice output; Artificial intelligence; Computer interfaces; Face; Graphics; Human computer interaction; Knowledge management; Monitoring; Multimedia systems; Prototypes; Speech;
Conference_Titel :
AI Systems in Government Conference, 1989.,Proceedings of the Annual
Conference_Location :
Washington, DC
Print_ISBN :
0-8186-1934-1
DOI :
10.1109/AISIG.1989.47332