Spectral domain cross correlation function and generalized Learning Vector Quantization for recognizing and classifying Indonesian Sign Language

This paper shows the first part of the automatic Indonesian Sign Language (SIBI) into text translation system. The focus of this project is on translation of the alphabet (A to Z) and numbers 1 to 10. Using a combination of a Kinect camera, Discrete Cosine Transform (DCT), Cross Correlation Function and classifying algorithm Generalized Learning Vector Quantization (GLVQ) can create a simple system to recognize alphabet A to Z and number 1 to 10 in Indonesian Sign Language. The skeleton extraction function and depth sensor from the Kinect camera are used to capture and transfer of hand gesture movements into frames of images. DCT is used to transform spatial data of each frame of image into its spectral domain. Collection of Cross Correlation values between same rows or columns of data from two consecutive frames can be used as a signature of a character. Each signature is unique and needs a small amount of data. GLVQ is used as the classifying algorithm to recognize the character. From our experiments, the system we proposed has obtained a high degree of accuracy in the recognition of alphabet and numbers in Indonesian Sign Language.