iSense3D: A real-time viewpoint-aware 3D video synthesis system

Author

Tsai, Sung-Fang ; Tsung, Pei-Kuei ; Chen, Kuan-Yu ; Li, Chung-Te ; Chen, Liang-Gee

Author_Institution

Grad. Inst. of Electron. Eng., Nat. Taiwan Univ., Taipei, Taiwan

fYear

2012

fDate

13-16 Jan. 2012

Firstpage

461

Lastpage

462

Abstract

In this paper, a real-time 3D video synthesis system is proposed. The system achieves more real 3D effect by dynamically adapts the synthesized view to user´s viewpoint. There are two major parts: 6D viewpoint parameter extraction, and real-time Free-Viewpoint View Synthesis(FVVS). 6D viewpoint parameter extraction is done by 3D object tracking over image and depth. Various techniques for FVVS are proposed and implemented on GPU to achieve real-time. The system is demonstrated on multi-core system with programmable GPU. Real-time performance up to 1280×720p with 30fps is achieved.

Keywords

graphics processing units; object tracking; real-time systems; solid modelling; 3D object tracking; 6D viewpoint parameter extraction; iSense3D; multicore system; programmable GPU; real-time 3D video synthesis system; real-time free-viewpoint view synthesis; viewpoint-aware 3D video synthesis system; Graphics processing unit; IEC; Parameter extraction; Real time systems; Rendering (computer graphics); Streaming media; Three dimensional displays;

fLanguage

English

Publisher

ieee

Conference_Titel

Consumer Electronics (ICCE), 2012 IEEE International Conference on

Conference_Location

Las Vegas, NV

ISSN

2158-3994

Print_ISBN

978-1-4577-0230-3

Type

conf

DOI

10.1109/ICCE.2012.6161944

Filename

6161944