Real time human pose recognition using leap motion sensor

Researchers have used one of the means for acquiring hand Signs like Web Camera, instrumented Glove, Depth Camera and Kinect sensor. In this paper, an Indian Sign Language recognition system is developed which recognizes ISL (with both hands) using Leap Motion sensor. This sensor overcomes the major issues in real time environment like background, lightening condition, and occlusion. The leap motion sensor captures the hand gesture and gives finger position in 3D format (X, Y, Z axis values). The positional information of five finger tips along with center of palm for both the hand is used to recognize sign posture based on Euclidean distance and Cosine similarity. The system was tested for ISL (Indian Sign Language alphabets) signs with 10 different signers. The average recognition accuracy of ISL is 88.39 % for Euclidean Distance method and 90.32 % for Cosine similarity. While performing sign, the Leap Motion Camera is kept about 10 degree inclined so that depth information is properly extracted. Although Leap Motion sensor tracks both the hand accurately it can´t track non manual signs which involve other body parts and facial expressions.