Video based augmented reality for immersive virtual reality system

We presented a method to configure a video based augmented reality system for an immersive virtual reality. Since an audience can not observe 3D user interaction processes in the personalized immersive virtual reality, we need a system to share 3D interaction to the audience like an augmented reality system. Building on the augmented reality system using an RGBD sensor, we refine unstable depth measurements in front of non-Lambertian objects by filtering the image in two-steps and removing the shadow effect. Finally, we showed depth-aware augmented reality images to demonstrate our system.