Title :
A novel compressed domain shot segmentation algorithm on H.264/AVC
Author :
Liu, Yang ; Wang, Weiqiang ; Gao, Wen ; Zeng, Wei
Author_Institution :
Dept. of Comput. Sci., Harbin Inst. of Technol., China
Abstract :
This paper presents a novel shot segmentation algorithm on the H.264/AVC video, which operates in the compressed domain. First, the algorithm exploits the intra prediction mode histogram to locate those potential GOPs, where shot transitions occur with great probability. Secondly, to further find shot boundaries at the frame level, we count the number of macroblocks with different inter prediction modes as the features and exploit HMMs to automatically model different cases in which shot transitions can occur among I, P and B frames. Since H.264/AVC provides more motion compensation modes, using HMMs can avoid the tediousness of manually tuning multiple thresholds simultaneously. The experimental results show that the algorithm is efficient and robust and it can not only locate cuts, but also work for gradual shot transitions.
Keywords :
code standards; data compression; hidden Markov models; image segmentation; motion compensation; prediction theory; video coding; H.264-AVC video; HMM; compressed domain; hidden Markov model; inter prediction mode; intra prediction mode histogram; motion compensation mode; potential GOP; shot segmentation algorithm; Automatic voltage control; Computer science; Encoding; Gunshot detection systems; Hidden Markov models; Histograms; Image coding; Image segmentation; Predictive models; Video compression;
Conference_Titel :
Image Processing, 2004. ICIP '04. 2004 International Conference on
Print_ISBN :
0-7803-8554-3
DOI :
10.1109/ICIP.2004.1421542