Development of human-machine interface composed of virtual reality and interface agent on process plant operation

Several studies on the human-machine interface (HMI) have progressed to decrease the human load on process plant operation. Among these studies, interface agents, which mediate between plant operators and process plants, are illuminated. On the other hand, information display systems have been studied and plant status representation using computer generated imagery (CGI) have been attempted. We report on a novel human-machine interface in plant operation composed of Interface Agent (IA) and Virtual Plant Agent (VPA). The IA monitors data of a process plant, communicates plant information to operators in voice and receives verbal operation commands from operators. We described the notion of an interface agent for plant operation and introduced a case based realization. The VPA was constructed by arranging all plant components which were modeled using CGI technology as in a real process plant. The VPA was linked to the IA through a local area network so that an operator was allowed to instruct the VPA to show plant status on the virtual space by Japanese voice commands. The VPA was enabled to display plant information such as modeled plant components, Japanese messages from the IA, literal expression of sensor data, abnormal indication by CGI with voice annunciation, visualized images for each component status, and real images from industrial TV at observation points. Furthermore, direct manipulation functionality for plant operation was also provided to the VPA. By connecting the IA and VPA to a simulator of an oil refinery plant, the demonstration has proved that the new HMI was useful to operate the plant