"Third-Person" Augmented Reality-Based Interactive Chinese Drama

This paper introduces a new form of augmented reality (AR) from a third person perspective which combines virtual elements with traditional elements in a live drama performance on stage. Actors" posture and gesture are recognized by using kinect. Upon recognition, corresponding virtual elements created within the Unity 3D game engine are generated, projected and superimposed over real elements on the real stage space using 3D holographic projection to create the final seamless augmented reality drama scene. This new approach takes the application of technology to drama art to the next level and gives performers more freedom to express themselves and convey their artistic expressions to the audience for a more immersive experience.