Title :
Video Aesthetic Quality Assessment by Temporal Integration of Photo- and Motion-Based Features
Author :
Hsin-Ho Yeh ; Chun-Yu Yang ; Ming-Sui Lee ; Chu-Song Chen
Author_Institution :
Inst. of Inf. Sci., Taipei, Taiwan
Abstract :
This paper presents a new method for accessing the aesthetic quality of videos. It consists of two processes: aesthetic features construction and temporal integration. First, our method combines both photo-based and motion-based visual clues to extract the aesthetic features for each frame in a video. We introduce new motion-based features built from optical flow and salient region extraction, and show their effectiveness to enhance the estimation of aesthetic values. Then, a temporal-order-aware framework that integrates the frame-based features is presented to further improve the evaluation accuracy by taking the time-varying properties into consideration. The experimental results demonstrate that our approach can accomplish remarkable improvement for aesthetic quality assessment of videos.
Keywords :
feature extraction; image motion analysis; image sequences; video signal processing; aesthetic feature extraction; aesthetic features construction; frame-based feature; motion-based features; optical flow; photo-based features; salient region extraction; temporal integration; temporal-order-aware framework; time-varying property; video aesthetic quality assessment; visual clues; Accuracy; Feature extraction; Image color analysis; Lighting; Quality assessment; Video recording; Visualization; Aesthetic quality assessment; computational aesthetics; image quality assessment; video quality assessment; visual aesthetics;
Journal_Title :
Multimedia, IEEE Transactions on
DOI :
10.1109/TMM.2013.2280250