Motion Recognition Employing Multiple Kernel Learning of Fisher Vectors Using Local Skeleton Features

We propose a skeleton-based motion recognition system focusing on local parts of the human body closely related to a target motion. In this system, a skeleton feature is composed of a sequence of relative positions between paired joints calculated by Inverse Kinematics. Several joints of skeleton model are connected as a Local Skeleton Feature. The temporal sequence is modeled as human motion model by using Hidden Markov Model. Motion features are represented as Fisher vectors parameterized by the human motion models, and weighted and integrated by using Multiple Kernel Learning. This system makes it possible for robots to recognize human actions in our daily life. The experimental results based on two datasets show an improvement in performance of classification rate, which shows that the design of motion feature is effective for motion recognition.