Title :
A hierarchical and multi-modal based algorithm for lead detection and news program narrative parsing
Author :
Kuo, Jin-Hau ; Kuo, Jen-Bin ; Chen, Hsuan-Wei ; WU, JA-LING
Author_Institution :
Dept. of Comput. Sci. & Inf. Eng., National Taiwan Univ., Taipei, Taiwan
Abstract :
In this paper, a hierarchical and multi-modal based news item detection algorithm, which can be viewed as a mid-stage solution between the single-modal and the semantic-based approaches, is proposed for parsing TV news program videos. We investigate the production model of TV news program first and then make use of the so-obtained domain knowledge to develop the proposed algorithm. With the add of multi-modal features, such as volume and zero crossing rate in audios and keyframe and human face in videos, the proposed algorithm showed rather satisfactory results in both precision and recall measures for parsing a 6-hour news program test video.
Keywords :
audio signal processing; grammars; image segmentation; video signal processing; TV news program video parsing; domain knowledge; hierarchical algorithm; human face; multimodal algorithm; multimodal features; news lead detection; news program narrative parsing; recall measure; semantic-based approach; zero crossing rate; Computer science; Databases; Detection algorithms; Gunshot detection systems; Information retrieval; Laboratories; Multimedia communication; Production; TV broadcasting; Videos;
Conference_Titel :
Advanced Information Networking and Applications, 2005. AINA 2005. 19th International Conference on
Print_ISBN :
0-7695-2249-1
DOI :
10.1109/AINA.2005.27
