Title :
An Information Theoretic Model of Spatiotemporal Visual Saliency
Author :
Qiu, Guoping ; Gu, Xiaodong ; Chen, Zhibo ; Chen, Quqing ; Wang, Charles
Author_Institution :
Univ. of Nottingham & Hong Kong Baptist Univ., Nottingham
Abstract :
This paper presents a principled and practical method for the computation of visual saliency of spatiotemporal events in full motion videos. Based on the assumption that uniqueness or informative-ness correlates with saliency, our model predicts the saliency of a spatiotemporal event based on the information it contains. To compute the uniqueness of the spatiotemporal events, we model the joint spatial and temporal conditional probability distributions of the spatiotemporal events and compute their spatiotemporal saliencies in a natural and integrated framework. To make the information theoretic model practical, we have developed methods to simplify the model and computational process. Testing results on several video sequences demonstrate that our model is effective in predicting visually salient spatiotemporal events and is comparable to state of the art. It is expected that our principled and practical model will find widespread applications in multimedia content analysis and processing.
Keywords :
image motion analysis; image sequences; statistical distributions; video signal processing; information theoretic model; motion videos; multimedia content analysis; spatiotemporal event; spatiotemporal visual saliency; temporal conditional probability distributions; video sequences; visual saliency; Computational modeling; Distributed computing; Motion analysis; Motion detection; Motion estimation; Predictive models; Probability distribution; Spatiotemporal phenomena; Testing; Video sequences;
Conference_Titel :
Multimedia and Expo, 2007 IEEE International Conference on
Conference_Location :
Beijing
Print_ISBN :
1-4244-1016-9
Electronic_ISBN :
1-4244-1017-7
DOI :
10.1109/ICME.2007.4285023