Annotation of fighting scenes with moving and changing backgrounds

In this paper, a novel method is proposed to annotate fighting scenes with moving and changing backgrounds. The proposed method is implemented in four major steps. Firstly, points of interests are extracted and traced to build the trajectory framework. Secondly, the global motion is estimated using trajectory records. Thirdly, camera motions are detected and classified. Fourthly, the behaviours of the points of interest are labelled by fuzzy scores and a voting scheme is proposed to annotate fighting scenes. Extensive experiments were carried out using PETS´04 database and Hollywood action films. The proposed method achieves satisfactory performances.