Title :
Enabling multimodal interaction in web-based personal digital photo browsing
Author :
Ismail, N.A. ; Brien, E. A O
Author_Institution :
Dept. of Comput. Graphics & Multimedia, Univ. Teknol. Malaysia, Skudai
Abstract :
Retrieval process of both digital photos and physical photos has not been easy, especially when the collections grow into thousands. In this paper, we describe an interactive web-based photo retrieval system that enables personal digital photo users to accomplish photo browsing by using multimodal interaction. This system not only enables users to use mouse clicks input modalities but also speech input modality to browse their personal digital photos in the World Wide Web (WWW) environment. The prototype system and it architecture utilize web technology which was build using web programming scripting (JavaScript, XHTML, ASP, XML based markup language) and image database in order to achieve its objective. All prototype programs and data files including the userpsilas photo repository, profiles, dialogues, grammars, prompt, and retrieval engine are stored and located in the web server. Our approach also consists of human-computer speech dialogue based on photo browsing of image content by four main categories (Who? What? When? and Where?). Our user study with 20 digital photo users showed that the participants reacted positively to their experience with the system interactions.
Keywords :
Internet; Java; XML; digital photography; human computer interaction; image retrieval; information retrieval; online front-ends; visual databases; ASP; JavaScript; Web programming scripting; Web server; Web-based personal digital photo browsing; World Wide Web; XHTML; XML based markup language; human-computer speech dialogue; image database; interactive Web-based photo retrieval system; multimodal interaction; personal digital photos; physical photos; retrieval engine; retrieval process; speech input modality; Application specific processors; Java; Markup languages; Mice; Prototypes; Service oriented architecture; Speech; Web sites; World Wide Web; XML;
Conference_Titel :
Computer and Communication Engineering, 2008. ICCCE 2008. International Conference on
Conference_Location :
Kuala Lumpur
Print_ISBN :
978-1-4244-1691-2
Electronic_ISBN :
978-1-4244-1692-9
DOI :
10.1109/ICCCE.2008.4580737