Sensor Enhanced Virtual Reality Teleoperation in Dynamic Environment

A novel teleoperation interface is introduced featuring an integrated virtual reality based simulation augmented by sensors and image processing capabilities on-board the remotely operated vehicle. The system addresses the typical limitations of video-based teleoperation caused by signal lag and limited field of view, allowing the operator to navigate in a continuous fashion. It also incorporates temporary autonomous operation of the vehicle enabling local obstacle navigation and automatic re-establishment of its teleoperated state. Finally, the system provides real time update of the virtual environment based on anomalies encountered by the vehicle. Future work is focused on incorporating dynamic moving objects in the environment