A Novel Multi-Touch Human-Computer-Interface Based on Binocular Stereo Vision

This paper presents a novel multi-touch interface based on binocular stereo vision, which achieves natural interactions through moving and clicking several fingers on an interface. The technology uses two cameras at different viewpoints to capture video images covering the interface in real time. We integrate skin-color information to track fingerpsilas motions. The clicking actions on the interface are detected with the obtained disparity of the fingertip position of two images. Thus a normal CRT/LCD display interface can be used as a multi-point touch-sensitive device. Experimental results demonstrate that the technology can realize robust tracking of finger motion, as well as the instant detection of finger clicking and moving actions. This technology achieves robust and natural human-computer interaction, and can be widely used in many applications, such as intelligent interaction, digital entertainment and wearable computing, etc.