Scarecrow: Avatar Representation Using Biological Information Feedback

Scarecrow is an avatar representation method that uses biological information to improve the immersive experience. Traditional computer games and virtual reality (VR) environments focus on operability and the immersive experience. Controller devices are used to communicate from the real world with the virtual world. The usability of control methods affect the immersive experience of the users. Recently, many of these VR environments have adopted motion sensors (e.g. Microsoft Kinect sensors) Motion sensors can measure the user´s movements and gestures to input control parameters for the virtual world and a self-avatar. Motion sensor-based games can help users to become more active and take steps to advance their health. Biological information, such as heart rate, body temperature, and muscle fatigue change depending on exercise volume. In this paper, we use a real-time biological information feedback to synchronize the user and the avatar representation. For instance, the color of the avatar changes according to the skin temperature of the user´s face. We hypothesize that this representation method will motivate user activities, and improve the immersive experience. We implement a Scarecrow prototype using a streaming server for measurements of the user´s behaviors and a front-end exercise game. We also perform an early user study to report the user experience and discuss the effects of the proposed method. We discuss the potential of the Scarecrow, which might encourage human exercise activities, and control human biological information.