A hierarchical and multi-modal based algorithm for lead detection and news program narrative parsing

Author

Kuo, Jin-Hau ; Kuo, Jen-Bin ; Chen, Hsuan-Wei ; WU, JA-LING

Author_Institution

Dept. of Comput. Sci. & Inf. Eng., National Taiwan Univ., Taipei, Taiwan

Volume

2

fYear

2005

fDate

28-30 March 2005

Firstpage

511

Abstract

In this paper, a hierarchical and multi-modal based news item detection algorithm, which can be viewed as a mid-stage solution between the single-modal and the semantic-based approaches, is proposed for parsing TV news program videos. We investigate the production model of TV news program first and then make use of the so-obtained domain knowledge to develop the proposed algorithm. With the add of multi-modal features, such as volume and zero crossing rate in audios and keyframe and human face in videos, the proposed algorithm showed rather satisfactory results in both precision and recall measures for parsing a 6-hour news program test video.

Keywords

audio signal processing; grammars; image segmentation; video signal processing; TV news program video parsing; domain knowledge; hierarchical algorithm; human face; multimodal algorithm; multimodal features; news lead detection; news program narrative parsing; recall measure; semantic-based approach; zero crossing rate; Computer science; Databases; Detection algorithms; Gunshot detection systems; Information retrieval; Laboratories; Multimedia communication; Production; TV broadcasting; Videos;

fLanguage

English

Publisher

ieee

Conference_Titel

Advanced Information Networking and Applications, 2005. AINA 2005. 19th International Conference on

ISSN

1550-445X

Print_ISBN

0-7695-2249-1

Type

conf

DOI

10.1109/AINA.2005.27

Filename

1423745