A User-Oriented Multimodal-Interface Framework for General Content-Based Multimedia Retrieval

Author

Ren, Jinchang ; Vlachos, Theodore ; Argyriou, Vasileios

Author_Institution

Centre for Vision, Speech & Signal Process., Surrey Univ., Guildford

fYear

2005

fDate

6-6 July 2005

Firstpage

812

Lastpage

815

Abstract

A user-oriented multimodal interface (MMI) framework is proposed. Considering the complexities of media connotations and uncertainties of the user´s demands, content-based retrieval has intrinsic requirements for MMI for effective media-content inter-actions. Through integration of knowledge based conduction, learning of semantic concepts, natural language processing and analysis of users´ profiles, our framework can establish a solid basis for design and implementation of general CBR systems satisfying extensibility, condensability and inter-operability

Keywords

content-based retrieval; image retrieval; knowledge based systems; learning (artificial intelligence); multimedia computing; natural language interfaces; natural languages; open systems; uncertainty handling; content-based multimedia retrieval; general CBR system; interoperability; knowledge based conduction; learning semantic concept; media connotation; media uncertainty; media-based interaction; multimodal-interface framework; natural language processing; user-oriented MMI; Computer science; Content based retrieval; Feedback; Information retrieval; Natural language processing; Shape; Signal processing; Speech processing; Uncertainty; User interfaces;

fLanguage

English

Publisher

ieee

Conference_Titel

Multimedia and Expo, 2005. ICME 2005. IEEE International Conference on

Conference_Location

Amsterdam

Print_ISBN

0-7803-9331-7

Type

conf

DOI

10.1109/ICME.2005.1521547

Filename

1521547