Title :
Cube2Video: Navigate Between Cubic Panoramas in Real-Time
Author :
Qiang Zhao ; Liang Wan ; Wei Feng ; Jiawan Zhang ; Tien-Tsin Wong
Author_Institution :
Tianjin Key Lab. of Cognitive Comput. & Applic., Tianjin Univ., Tianjin, China
Abstract :
Online virtual navigation systems enable users to hop from one 360° panorama to another, which belong to a sparse point-to-point collection, resulting in a less pleasant viewing experience. In this paper, we present a novel method, namely Cube2Video, to support navigating between cubic panoramas in a video-viewing mode. Our method circumvents the intrinsic challenge of cubic panoramas, i.e., the discontinuities between cube faces, in an efficient way. The proposed method extends the matching-triangulation-interpolation procedure with special considerations of the spherical domain. A triangle-to-triangle homography-based warping is developed to achieve physically plausible and visually pleasant interpolation results. The temporal smoothness of the synthesized video sequence is improved by means of a compensation transformation. As experimental results demonstrate, our method can synthesize pleasant video sequences in real time, thus mimicking walking or driving navigation.
Keywords :
image matching; image sequences; interpolation; video signal processing; Cube2Video; cubic panoramas; matching-triangulation-interpolation procedure; online virtual navigation systems; physically plausible pleasant interpolation; sparse point-to-point collection; spherical domain; synthesized video sequence; temporal smoothness; triangle-to-triangle homography-based warping; video-viewing mode; visually pleasant interpolation; Educational institutions; Interpolation; Measurement; Navigation; Optical imaging; Real-time systems; Streaming media; Cubic panoramas; Temporal smoothness; Triangle-to-triangle homography-based warping; Video-viewing mode; Virtual navigation;
Journal_Title :
Multimedia, IEEE Transactions on
DOI :
10.1109/TMM.2013.2280249