Visual Predictive Control of Robot Manipulators Using a 3D ToF Camera

This paper presents a visual servo strategy for an anthropomorphic manipulator with eye-to-hand configuration. As novelty, a time-of-flight (ToF) camera, together with a model-based predictive control (MPC), have been used to execute the manipulator tasks in an unstructured environment. The ToF camera provides 3-D data of a target object and the MPC cost function achieves convergence of robot motion. With this configuration, there is no requirement to estimate a 3-D feature point position from a 2-D image and the camera model. A procedure for the target segmentation on the depth data, which is based on a previous training, is also presented. Experimental results, obtained in a robotic platform, show that the proposed approach is well suited for visual servoing purposes.