Real-time vision-based station keeping for underwater robots

Concerns the design and implementation of a control system for automatic vision-based station keeping with an underwater ROV, relative to some visual landmark. First, a region-based tracking system is described that tracks naturally textured landmarks in the image plane, based upon full planar-projective motion models. Most of the computation can be done off-line. Robustness is added to the algorithm by integrating optic flow information and by learning expected image motions. The problem of automatically selecting promising landmarks is addressed, based on the information in the texture map. We then turn to the vision-based control problem that uses the information provided by the tracker, to station keep an underwater ROV. A decoupled control design is presented for positioning the vehicle relative to a visual landmark, while maintaining a fixed depth. Additionally, an image stabilization technique is developed, which aims to keep the landmark centered in the image plane during station keeping maneuvers, by using a pan and tilt camera. The system was tested under real conditions and results obtained from station keeping tests at open sea are presented