A self-calibration technique for active vision systems

A manipulator wrist-mounted camera considerably facilitates motion stereo, object tracking, and active perception. An important issue in active vision is to determine the camera position and orientation relative to the camera platform (head-eye calibration or hand-eye calibration). We present a technique for calibrating the head-eye geometry and the camera intrinsic parameters. The technique allows camera self-calibration because it requires no reference object and directly uses the images of the environment. Camera self-calibration is important especially where the underlying visual tasks do not permit the use of reference objects. Our method exploits the flexibility of the active vision system, and bases camera calibration on a sequence of specially designed motion. It is shown that if the camera intrinsic parameters are known a priori, the orientation of the camera relative to the platform can be solved using 3 pure translational motions. If the intrinsic parameters are unknown, then two sequences of motion, each consisting of three orthogonal translations, are necessary to determine the camera orientation and intrinsic parameters. Once the camera orientation and intrinsic parameters are determined, the position of the camera relative to the platform can be computed from an arbitrary nontranslational motion of the platform. All the computations in our method are linear. Experimental results with real images are presented