Robust corner tracking for multimedia applications

The paper addresses the problem of corner tracking for multimedia applications in the presence of occlusion. To extract corners from each frame of a video sequence, multi-scale enhanced CSS (curvature scale space) corner detection is applied. In the matching stage, two-frame correspondence using multiple match hypotheses is considered. Due to occlusion, not only the corners of the first frame, but also all the corners that appear for the first time in each frame are tracked through the input sequence. To remember the path of corners when tracking, each corner has a record. The record for each tracked corner includes the numbers of the start and end frames during the tracking of these corners in a sequence. By tracking new corners, the corners of hidden moving objects appear again and are tracked after disocclusion. We apply the proposed method to a number of real video sequences. All experiments confirm that the proposed corner tracker performs more robustly and it is practical even when occlusion happens.