Title :
Action change detection in video by covariance matching of silhouette tunnels
Author :
Guo, Kai ; Ishwar, Prakash ; Konrad, Janusz
Author_Institution :
Dept. of Electr. & Comput. Eng., Boston Univ., Boston, MA, USA
Abstract :
Action recognition is an important but challenging problem in video analytics with a number of solutions proposed to date. However, even if a reliable model for action representation is identified and an accurate metric for comparing actions is developed, it is still unclear to how many video frames should the representation and comparison apply. In this paper, we develop a method to detect when actions change, i.e., the temporal boundaries of actions, without classifying the actions. We use a silhouette-based framework for action representation and comparison, both centered around dimensionality reduction using covariance descriptors. We use a nonparametric statistical framework to learn the distribution of the distance between covariance descriptors and detect action changes as covariance-distance outliers. Experimental results on ground-truth data show 1.64% false negative error and 0.19% false positive error, while those for surveillance video agree 100% with manual annotations.
Keywords :
covariance analysis; image representation; object detection; video surveillance; action change detection; action recognition; action representation; covariance descriptors; covariance matching; dimensionality reduction; nonparametric statistical framework; silhouette tunnels; surveillance video; video analytics; Cameras; Feature extraction; Humans; Layout; Motion analysis; Photometry; Shape; Solid modeling; Surveillance; Video sequences; Action recognition; covariance matching; silhouette tunnels; video analytics;
Conference_Titel :
Acoustics Speech and Signal Processing (ICASSP), 2010 IEEE International Conference on
Conference_Location :
Dallas, TX
Print_ISBN :
978-1-4244-4295-9
Electronic_ISBN :
1520-6149
DOI :
10.1109/ICASSP.2010.5495354