Title :
A system for effortless content annotation to unfold the semantics in videos
Author :
Lienhart, Rainer
Author_Institution :
Microprocessor Res. Lab., Intel Corp., Santa Clara, CA, USA
Abstract :
We propose and investigate a new but simple and natural extension of the way people record video. This extension allows one to unfold the semantics of video clips and thus enables a completely new set of applications for raw video footage. Two microphones are connected to a camcorder: a headworn speech input microphone and an environmental microphone. During recording the cameraman speaks out loud content-descriptive annotations and/or editing commands. Due to the two-microphones setup the sound of annotations and editing commands can be removed from the environmental audio by adaptive filtering enabling people to play back the video as if there had been no annotations. Simultaneously, these annotations are transcribed to ASCII by means of a standard speech recognition engine. The viability of this approach is demonstrated by means of an important application for video libraries: the automatic abstraction of raw video footage
Keywords :
content-based retrieval; microphones; natural languages; speech recognition; telecommunication computing; video databases; video signal processing; ASCII; adaptive filtering; automatic abstraction; camcorder; cameraman; content annotation; content-descriptive annotations; editing commands; environmental microphone; headworn speech input microphone; microphones; raw video footage; semantics; speech recognition engine; video clips; video libraries; videos; Speech recognition;
Conference_Titel :
Content-based Access of Image and Video Libraries, 2000. Proceedings. IEEE Workshop on
Conference_Location :
Hilton Head Island, SC
Print_ISBN :
0-7695-0695-X
DOI :
10.1109/IVL.2000.853838
