Title :
Discontinuous seam cutting for enhanced video stitching
Author :
Jie Hu ; Dong-Qing Zhang ; Yu, Heather ; Chang Wen Chen
Author_Institution :
Dept. of CSE, Univ. at Buffalo, Buffalo, NY, USA
fDate :
June 29 2015-July 3 2015
Abstract :
Video stitching requires proper seam cutting technique to decide the boundary of the sub video volume cropped from source videos. In theory, approaches such as 3D graph-cuts that search the entire spatiotemporal volume for a cutting surface should provide the best results. However, given the tremendous data size of the camera array video source, the 3D graph-cuts algorithm is extremely resource-demanding and impractical. In this paper, we propose a sequential seam cutting scheme, which is a dynamic programming algorithm that scans the source videos frame-by-frame, updates the pixels´ spatiotemporal constraints, and gradually builds the cutting surface in low space complexity. The proposed scheme features flexible seam finding conditions based on temporal and spatial coherence as well as salience. Experimental results show that by relaxing the seam continuity constraint, the proposed video stitching can better handle abrupt motions or sharp edges in the source, reduce stitching artifacts, and render enhanced visual quality.
Keywords :
dynamic programming; image segmentation; video signal processing; camera array video source; cutting surface; discontinuous seam cutting; dynamic programming algorithm; low space complexity; pixels spatiotemporal constraints; seam continuity constraint; sequential seam cutting scheme; source videos frame-by-frame scan; spatial coherence; spatiotemporal volume; subvideo volume boundary; temporal coherence; video stitching; visual quality; Cameras; Coherence; Dynamic programming; Image edge detection; Spatial coherence; Spatiotemporal phenomena; Three-dimensional displays; Dynamic seam cutting; Spatial coherence; Temporal coherence; Video stitching;
Conference_Titel :
Multimedia and Expo (ICME), 2015 IEEE International Conference on
Conference_Location :
Turin
DOI :
10.1109/ICME.2015.7177506