Abnormal activity recognition using spatio-temporal features

Abnormal activity detection plays an important role in many areas such as surveillance, military installations, and sports. Existing abnormal activity detectors mostly rely on motion data obtained over a number of frames to characterize abnormality. However, only motion may not be able to capture all forms of abnormality, in particular, poses that do not amount to motion "outliers". In this paper, we propose two different spatio-temporal descriptors, a silhouette and optic flow based method and a dense trajectory based method which additionally include trajectory shape descriptor, to detect abnormalities. These two descriptors enable us to classify abnormal versus non-abnormal activities using SVM. Comparison with existing methods, using five standard datasets, shows that dense trajectory based method outperforms state-of-the-art results in crowd dataset and silhouette and optic flow based method outperforms others in some datasets.