Enhancement of Stage Performances by Projecting CG Animation and Control of Images with Sensors

We have been producing live stage performances using computer graphics (CG) and interactive techniques. We developed a system to support and enhance live performances. This system projects CG onstage alongside real actors and allows users to control the projected images in real time. Collaborative scenes between real actors and virtual actors created by CG are possible. The system has multi-functions and is flexible, hence, it can be used for purposes other than performances. The system helps directors and actors in the creation of performances, as well as during rehearsals. Moreover, the system is portable and easy to set up in various types of theaters. The system can use sensor devices to determine physical expressions of actors or spectators. These perceived states can be used to affect projected images, which can provide a richer presentation. This paper describes the structure of the system and its effects in live performances that we attempted.