Title :
Video summarization using reinforcement learning in eigenspace
Author :
Masumitsu, Ken ; Echigo, Tomio
Author_Institution :
IBM Tokyo Res. Lab., Kanagawa, Japan
Abstract :
We propose video summarization using reinforcement learning. The importance score of each frame in a video is calculated from the user´s actions in handling similar previous frames; if such frames were watched rather than skipped, a high score is assigned. To calculate the score, instead of using raw feature vectors extracted from images, we use feature vectors projected on eigenspace: as a result, we can deal with the features comprehensively. We also give an algorithm that uses the reinforcement learning method to create a personalized video summary. The summarization algorithm is applied to a soccer video to confirm its effectiveness.
Keywords :
feature extraction; image sequences; learning (artificial intelligence); video signal processing; algorithm; eigenspace; feature vectors extraction; personalized video summary; reinforcement learning; soccer video; summarization algorithm; video frame; video summarization; Data mining; Feature extraction; Information retrieval; Joining processes; Laboratories; Layout; Learning; Multimedia communication; TV broadcasting; Watches;
Conference_Titel :
Image Processing, 2000. Proceedings. 2000 International Conference on
Print_ISBN :
0-7803-6297-7
DOI :
10.1109/ICIP.2000.899351