Real time stereo rendering for augmented reality on 3DTV system

Recent computer vision technology has made great progress in 3DTV industry. The advent of 3DTV to the home raises a number of challenges beyond the basic display of an available stereo pair. One of them is the production of 3D augmented contents. To present virtual objects over the real world, the existing method is offline processing in postproduction. It is a difficult and expensive work since flexible equipments are required and the cost of postproduction is high. In this paper, low cost approaches to product 3D augmented contents in real time are proposed. In order to make such application running in real time, we use OpenGL to render the stereo pair of 3D augmented contents. Specific rendering order is needed to avoid the flicker of compositing image. As camera moves, the image of virtual objects must be generated and combined perspectively correct with the real image. We use marker tracking technology for real time camera tracking. The experimental results show that our method is suitable for rendering the stereo pair of 3D augmented contents in real time. Running on an NVIDIA Quadro FX4800 graphic card, for each 640×360 stereo pair of 3D augmented contents, the proposed method reaches the speed of 16 ms for rendering two views.