Fingertip detection and tracking using 2D and 3D information

In this paper, a method for the tracking of fingertip in scenes with complex background is proposed. Our method uses a trinocular stereo vision system, named Digiclops, to capture images and to segment finger blocks. For the case that the finger perpendicularly points to a camera, the fingertip can be rapidly located using a statistic-based method. While for other cases, a robust algorithm for fingertip detection is presented in this paper. Experimental results show that the proposed method can accurately track the fingertip at a speed of about 9.1 frames per second for the 1024times768 images and can be used for the construction of Perceptual User Interface (PUI) system.