CUBot: Prototype of a computer-using robot

Pointing at objects on screen through cursor is a significant function for manipulating a personal computer. A prototypical robot CUBot¹, which can perceive the content displayed on the PC´s screen and control the PC´s mouse to perform the interaction with PC like a computer user, is presented in this paper. A heuristic control algorithm is developed for the CUBot so that it possesses the ability of eye-hand coordination to perform the pointing strategy onto PC´s screen like human. Two missions of CUBot manipulating a PC are implemented to demonstrate the feasibility of the proposed design.