A basic study on virtual collaborator as an innovative human-machine interface in distributed virtual environment: the prototype system and its implication for industrial application

This paper develops “virtual collaborator” as a new type of human-machine interface, which works as “intelligent interface agent” to help machine operators manipulating large scale machine system such as power plants. The virtual collaborator is a kind of “virtual robot” which behaves as if an intelligent agent robot in virtual reality space, who can communicate naturally with human like humans do with each other. A prototype system has been constructed, which has no communication function with humans; it can behave just like a plant operator in the simulated control room of nuclear power plant in virtual reality space. The animation of operator behavior is visualized on the large projection display, and the presented virtual operator can verbalize what is in “his mind”, and explain what he is thinking. Although the current prototype system has no bi-directional communication capability with human, it can be applied to some industrial fields