Automated MPEG audio-video summarization and description

The paper proposes a novel method for automatically summarizing MPEG coded audio-video content in the compressed domain, and describing audio-video summaries in the MPEG-7 standard format. Semantically important features for summary generation are carefully analyzed, and two types of summaries, digest and highlight, are extracted. A digest extraction is based on an audio level estimation and visual features analysis, where digest shots are adaptively determined for user-specified duration by utilizing the MPEG-7 based motion features. A highlight-based summarization from TV broadcast sports programmes is achieved by analyzing audio class and audio level. The extracted summaries and related features are described by the MPEG-7 description tools. Experimental results show that the digests and highlights can be successfully extracted in various kinds of contents without a priori knowledge of content characteristics.