DocumentCode :
1361479
Title :
Fast JND-Based Video Carving With GPU Acceleration for Real-Time Video Retargeting
Author :
Chiang, Chen-Kuo ; Wang, Shu-Fan ; Chen, Yi-Ling ; Lai, Shang-Hong
Author_Institution :
Dept. of Comput. Sci., Nat. Tsing Hua Univ., Hsinchu, Taiwan
Volume :
19
Issue :
11
fYear :
2009
Firstpage :
1588
Lastpage :
1597
Abstract :
A recently developed image resizing technique, seam carving, has been proved to be a useful tool for content-adaptive spatially nonuniform image resizing with the purpose of optimal display on a screen of reduced resolution or different aspect ratio. In this paper, we present a fast algorithm for real-time content-aware video retargeting based on the improved seam carving method proposed in this paper. The proposed algorithm is designed to be highly parallelizable and suitable for running on a multicore architecture. First, two novel operators, i.e., seam update and seam split, are introduced to analyze an image for detecting the local and global seams with minimum costs very efficiently. With these operators, parallel processing can be achieved to determine multiple seams simultaneously. In addition, the saliency measure is extended with a just-noticeable-distortion model which makes the resized video more consistent with human perception. We demonstrate the efficiency of the above new components with a graphics processing unit (GPU) implementation. In addition, the proposed fast seam carving algorithm is extended for video retargeting. To the best of our knowledge, this is the first paper based on the seam carving method to achieve real-time video retargeting on a GPU. Experimental results on video sequences of various characteristics are demonstrated to show the superior performance of the proposed algorithm in comparison with the existing content-adaptive image/video resizing methods.
Keywords :
computer graphics; image enhancement; parallel architectures; real-time systems; video signal processing; GPU acceleration; JND-based video carving; graphics processing unit; human perception; image enhancement; image resizing technique; just-noticeable-distortion model; local minimal property; multicore architecture; multiple local seam; parallel processing; real-time content-aware video retargeting; seam carving method; Graphics processing unit; seam carving; video retargeting;
fLanguage :
English
Journal_Title :
Circuits and Systems for Video Technology, IEEE Transactions on
Publisher :
ieee
ISSN :
1051-8215
Type :
jour
DOI :
10.1109/TCSVT.2009.2031462
Filename :
5229299
Link To Document :
بازگشت