A collaborative augmented reality system using transparent display

Augmented reality is a technique to integrate the virtual (i.e., computer-generated) information with objects in the real world. Real world objects can thus be augmented in their properties and functions with the help of a computer. One of the authors has proposed an augmented reality system in which a transparent display is used as a means of integration of the real world and the virtual world. This paper discusses an extension of the system so that it can be used in a collaborative working environment. Capturing the gesture as a means of user interaction is realized by a single camera, aiming at simplifying the system setup and image analysis. We propose an idea of utilizing statistical data of human body and human´s perceptional characteristics, as well as vision techniques. Two applications are presented to explain the usefulness of the system: one is a game-like application, which we call mind-to-mind communication, and the other a messenger object.