A prototype of goldfish software robot with real-time response function by a parallel computer

This paper describes a parallel computing system and a software algorithm for real-time interaction between a human user and the synthesized moving goldfish images. Two realistic goldfish agents appearing on a display can recognize the palm position and finger motion (finger sign) of the user, then respond to them in real-time. The authors have named this kind of interactive agent a `software robot´. A modeling software named `BSSM´ (Bone-Structured Solid Modeler), which is suitable for representing deformable objects (such as living things) plays an important role in the synthesis of realistic goldfish images. To realize the real-time interaction, they have developed an image recognition and synthesis system `TN-VIT´ (Transputer Network with Visual Interface for Transputers). The image synthesis speed of the TN-VIT is about 25 frames per second including the finger-sign recognition process. The technology discussed is expected to play an important role in the realization of future visual human interfaces