Action-oriented sensor fusion for telesystems

Work in sensor fusion for fully autonomous mobile robots that is expected to be useful for telesystems is discussed. Emphasis is placed on one product of this work, i.e. the sensor fusion effects (SFX) architecture, which can be extended into a control scheme for sensor fusion in telesystems. It can reduce the teleoperator´s time in supervising the execution of a telerobot´s sensing strategy and adapting that strategy to sensor malfunctions, changes in the environment, and other unanticipated sensing problems. It does this by autonomously monitoring the execution of the sensing strategy and looking for abnormalities. If an abnormality is detected, SFX initiates an exception handling process which tries to repair the sensing strategy autonomously. If that is not possible, the exception handling module gathers as much relevant information as possible and recommends a course of action for the operator. Experiments with sensor data collected from a Sony Hi8 color camcorder, a Pulnix black and white camera, an Inframetrics true infrared camera, Polaroid ultrasonic transducers, and a Hamamatsu ultraviolet light camera on a mobile robot show that SFX can autonomously monitor the execution of a sensing strategy and detect abnormalities