Space-time A Contrario Clustering for Detecting Coherent Motions

This paper presents a method for detecting independent temporally-persistent motion patterns in image sequences. The result is a description of the dynamic content of a video sequence in terms of moving objects, their number, image position and approximate motion. For each detected motion pattern a local trajectory as well as a confidence level is provided. The method is based on local motion measurements extracted from short video segments. These measurements are mapped in an adequate grouping space where independent trajectories correspond to distinct clusters. The automatic cluster detection is handled in an a contrario framework, which is general and involves no parameter tuning. The method was validated on real video sequences featuring rigid and non-rigid moving objects, static and mobile cameras, and distracting motions. The output of this method could initialize tracking algorithms. Applications of interest are robot navigation, car-driver assistance, surveillance and activity recognition.