Title :
AIMtechKinect: A Kinect Based Interaction-Oriented Gesture Recognition System Designed for Students with Severe Intellectual Disabilities
Author :
Chen Li ; Ip, Horace Ho-Shing
Author_Institution :
Dept. of Comput. Sci., City Univ. of Hong Kong, Hong Kong, China
Abstract :
Microsoft Kinect sensors nowadays are widely used for real-time controller-free virtual reality (VR) interactions. However, there has been limited research on interaction-oriented analysis of motion data captured by Kinect from those who suffer from both intellectual and physical challenges. In this paper, a software framework based on Kinect is proposed to support a psycho-educational program (InSPAL) in a special school setting, which aims to enable students with severe intellectual disabilities (SID) to interact with the educational VR content and through which their pre-learning skills could be enhanced. Also, algorithms embedded in this framework are designed and modified in order to overcome limitations of the sensor and challenges originated from unique features of SID students´ body movement.
Keywords :
computer aided instruction; gesture recognition; image sensors; virtual reality; AIMtechKinect; InSPAL program; Kinect based interaction-oriented gesture recognition system; Microsoft Kinect sensors; VR interactions; educational VR content; motion data analysis; psycho-educational program; realtime controller-free virtual reality interactions; software framework; special school setting; student body movement; student prelearning skills; students with severe intellectual disabilities; Engines; Feature extraction; Gesture recognition; Hidden Markov models; Joints; Sensors; Gesture Recognition; Kinect; Motion Capture; Natural User Interface; Virtual Reality;
Conference_Titel :
Computer-Aided Design and Computer Graphics (CAD/Graphics), 2013 International Conference on
Conference_Location :
Guangzhou
DOI :
10.1109/CADGraphics.2013.49
