Title :
Dynamic time wrapping based gesture recognition
Author :
Masood, Sarfaraz ; Parvez Qureshi, Majid ; Shah, Mehul B. ; Ashraf, Sharmin ; Halim, Zahid ; Abbas, Ghulam
Author_Institution :
Fac. of Comput. Sci., Ghulam Ishaq Khan Inst. of Eng. Sci. & Technol., Topi, Pakistan
Abstract :
Sign language provides hearing and speech impaired people with an interface to communicate with society. Unfortunately most people do not understand sign language. For this, image processing and pattern recognition can provide with a vital tool to detect and translate sign language into vocal language. This work presents a method for detecting, understanding and translating sign language gestures to vocal language. Microsoft Kinect is the primary tool used to capture video stream of the user. This is achieved by getting skeleton frame from Kinect and then extracting joints of interest. The data obtained are normalized and a linked list of skeleton frame is maintained. The proposed method is capable of successfully detecting all gestures that do not involve finger movements. The proposed system has an accuracy of 91%.
Keywords :
bone; hearing; pattern recognition; sign language recognition; video streaming; Microsoft Kinect; dynamic time wrapping; gesture recognition; hearing; image processing; pattern recognition; sign language; skeleton frame; speech impaired people; video stream; vocal language; Accuracy; Assistive technology; Dictionaries; Gesture recognition; Joints; Thumb; Feature extraction; Image recognition; Image sequence analysis; Multimodal sensors; Pattern recognition;
Conference_Titel :
Robotics and Emerging Allied Technologies in Engineering (iCREATE), 2014 International Conference on
Conference_Location :
Islamabad
Print_ISBN :
978-1-4799-5131-4
DOI :
10.1109/iCREATE.2014.6828366