Action Recognition Using Spatio-Temporal Distance Classifier Correlation Filter

The problem of recognizing human actions is characterized by complex dynamics and strong variations in their executions. Despite this inconvenience, space-time correlations provide valuable clues for their discrimination. Therefore, space-time correlators like Maximum Average Correlation Height (MACH) filters have successfully been used for action recognition with encouraging results. However, their utility is challenged due to number of factors: (i) these filters are trained only for one class at a time and separate filters are required for each class increasing computational overhead, (ii) these filters simply take average of similar action instances and behave no better than average filters and (iii) misaligned action datasets create problems for these filters as they are not shift-invariant. In this paper, we address these issues by posing action recognition as a multi-class discrimination problem and propose a single 3D frequency domain filter, named Action ST-DCCF for multiple action classes that mitigates inherent discrepancies of correlation filters. It presents a different interpretation of correlation filters as a method of applying spatio-temporal transformation to the data rather than simply minimizing correlation energy across all possible shifts. Experiments on a variety of action datasets are performed to evaluate our approach. Experimental results are comparable to the existing action recognition approaches.