Video Abstraction Based on Relational Graphs

Video abstraction plays an important role in video browsing, video indexing, video retrieval and other video applications. In the paper, an automatic video abstraction method is developed based on relational graph representations. Firstly, a relational graph is constructed for all the frames in a video sequence. Secondly, the graph is partitioned into different connected subgraphs. Thirdly, Isomap is performed to reduce the dimensionality of the data set, and the output of Isomap is used as feature vector of the video frames. Lastly, a mixture model with model selection is introduced to generate the fine grain video abstraction with the centre of each clustering as the keyframes. Experiments are conducted on real world video sets with satisfying video abstraction results.