Real time finger writing recognition system for human computer interaction

This paper proposes a real time finger writing recognition system using a web camera to enable user to interact with computer systems by their own bare hands. The hand region is firstly extracted by background subtraction and blob labeling. Then, convex hull and convexity defect are used to count the fingers and detect the fingertip coordinates. The trajectory of the fingertip is smoothed and drawn to become a finger writing character. Next, it is recognized by the Support Vector Machine classifier, which is trained with our collected database and specific parameters for finger writing recognition. Finally, the event corresponding to the character is sent to the computer systems. Experimental results show that the proposed system can successfully count the fingers and recognize the finger writing English characters with the accuracies of 98.3% and 83.4% respectively.