Free viewpoint action recognition based on self-similarities

Action recognition is an important topic in computer vision and most current work focuses on view-dependent representations. In this paper, we develop a novel free viewpoint action recognition based on Self-similarity matrix (SSM), which tends to be stable across views. We choose Local Self-similarity (LSS) descriptor as our low-level feature, then SSM is calculated by computing the similarity between any pair of frame features. Each video sequence is represented using a diagonal descriptor vector extracted from the SSM. Support Vector Machines (SVM) is employed for classification. The encouraging experimental results on the public IXMAS multi-view data set demonstrate effectiveness of the proposed method.