Tracking Salient Keypoints for Human Action Recognition

It plays an important role to recognize human actions from realistic videos in multimedia event detection and understanding. To this aim, a novel human tracking approach is proposed in this paper. Firstly, salient key points trajectories are generated to track human actions at multiple spatial scales. Then, camera motion elimination is utilized to further improve the robustness of motion trajectories. To depict human motions accurately and efficiently, the Histogram of Oriented Gradient (HOG), Histogram of Optical Flow (HOF) and Motion Boundary Histogram (MBH) are employed with the Fisher vector model being utilized to aggregate these three features. Extensive experimental results on four challenging human action video datasets demonstrate that the proposed approach is able to achieve better recognition performances in a more computationally efficient manner as compared with a number of state-of-the-art approaches.