3-D reconstruction using the Kinect sensor and its application to a visualization system

These days, a large number of human-computer interactive systems have been developed. This paper proposes a visualization system of reconstructed three-dimensional (3-D) scene, which is based on user-interactive control using the Kinect sensor and a webcam. First, we acquire depth and color images from a number of viewpoints, from which 3-D reconstruction of a scene is performed. We pre-process the acquired data to improve 3-D reconstruction result. Then, we reconstruct the 3-D scene for the visualization system that uses face detection and tracking with a webcam. Experimental results show that our system gives a visualized 3-D scene reconstruction simply using the Kinect sensor and a webcam. It can be applied to a human-interaction display system at museum, amusement park, and so on.