Virtual 3-D interface system via hand motion recognition from two cameras

Author

Abe, Kiyofumi ; Saito, Hideo ; Ozawa, Shinji

Author_Institution

Dept. of Inf. & Comput. Sci., Keio Univ., Yokohama, Japan

Volume

32

Issue

4

fYear

2002

fDate

7/1/2002 12:00:00 AM

Firstpage

536

Lastpage

540

Abstract

We propose a new human interface system, the virtual 3D interface system, which allows a user to work in a virtual three-dimensional (3D) space on the computer by way of hand motions and hand poses. This system has two cameras: one takes the top-view of the desktop and the other takes the side-view. With the top-view image, the system recognizes the bending of the five fingers and interprets the command. At the same time, the system extracts the fingertip of the forefinger in both the top-view and the side-view images, and then estimates the 3D position of the fingertip. These procedures are very simple so that we can develop some real-time 3D application systems.

Keywords

gesture recognition; graphical user interfaces; motion estimation; real-time systems; virtual reality; 3D position estimation; cameras; fingertip extraction; forefinger; hand motion recognition; hand pose estimation; real-time 3D application systems; side-view images; top-view image; virtual 3-D interface system; Application software; Cameras; Computer interfaces; Computer vision; Fingers; Humans; Image recognition; Keyboards; Pattern matching; Real time systems;

fLanguage

English

Journal_Title

Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on

Publisher

ieee

ISSN

1083-4427

Type

jour

DOI

10.1109/TSMCA.2002.804821

Filename

1158972