Title :
A new video similarity measure model based on video time density function and dynamic programming
Author :
Jiang, Junfeng ; Zhang, Xiao-Ping ; Loui, Alexander C.
Author_Institution :
Dept. of Electr. & Comput. Eng., Ryerson Univ., Toronto, ON, Canada
Abstract :
In this paper, we propose a novel video similarity measure model using video time density function (VTDF) and dynamic programming. First, we employ VTDF to describe the density of video activities in time domain by calculating the inter-frame mutual information. Second, a temporal partition solution is applied to divide each video sequence into equi-sized temporal segments. Third, a new VTDF based similarity measure using correlation is calculated to measure the similarity between two temporal segments. Fourth, dynamic programming is then developed to find the optimal non-linear mapping between two video sequences. A new normalized similarity measure function combing both visual characteristics and temporal information together is to evaluate the semantic similarity of two video sequences. Experimental results show that the proposed measurement model is effective to explore the semantic similarity of video sequences.
Keywords :
correlation methods; dynamic programming; image sequences; VTDF based similarity measure; correlation method; dynamic programming; equisized temporal segments; inter-frame mutual information; normalized similarity measure function; optimal nonlinear mapping; time domain; video sequence; video similarity measure model; video time density function; Correlation; Dynamic programming; Image color analysis; Semantics; Streaming media; Transform coding; Video sequences; Video similarity measure; correlation; dynamic programming; video time density function;
Conference_Titel :
Acoustics, Speech and Signal Processing (ICASSP), 2011 IEEE International Conference on
Conference_Location :
Prague
Print_ISBN :
978-1-4577-0538-0
Electronic_ISBN :
1520-6149
DOI :
10.1109/ICASSP.2011.5946625