A framework toward detecting and visualizing kinematic data for children with Hemiplegia

In this paper we propose a multimedia environment that can capture kinematic data from live gestures of a child having Hemiplegia disability and generate live analytical results to be useful for decision making system of a therapist. The kinematic data is obtained from some clinically suggested therapy modules that are used to monitor quality of improvement of a disabled child, which includes exercises involving the affected joints and muscles. The proposed environment uses the 3D depth sensing Microsoft Kinect device to detect, recognize and track the movement of different key joints of the body and deduce kinematic data from these movements. The method is non-invasive as the child does not need to wear any external devices in the body. The proposed environment incorporates Second Life serious game environment where the live therapeutic movement of child, therapist and one´s community of interest is synchronized between physical and virtual world. Finally, we share our preliminary test data, which is validated by the therapists from three different disability hospitals that treat children with Hemiplegia.