Acceleration of Dynamic Spatial Augmented Reality System with a Depth Camera

Recently, spatial augmented reality (SAR) has been used as a method of editing appearance of real objects by using a projector. In addition to SAR with stationary objects, SAR with moving objects is paid attention to in case of entertainments, work supports, design study, and so on. Although such dynamic SAR requires pose estimation and tracking, it cannot accomplish enough accuracy and processing speed by using non-contact measurement by cameras. Therefore, in this research, we propose optimization of point cloud data used for the tracking at off-line and on-line processes, and accomplish acceleration of the SAR system which we have achieved with a depth camera.