A reachable user interface by the graphically Extended Hand

In this paper, we propose a novel user interface called `Extended Hand´, which is a graphical extension of a user´s hand. User can access real objects by manipulating Extended Hand; the forces control the position and orientation of Extended Hand. The system can detect the pressing of each finger and its pressing direction in video processing. The Graphical Extended Hand is projected onto a desktop surface by adjusting its position and rotation in computer graphics (CG). In order to determine the control parameters, we experimented the pressure and pressing direction of each finger. As user´s hand is psychologically and graphically extended, the user is able to access distant objects naturally in mixed reality sense.