Evaluation of MPEG7 color descriptors for visual surveillance retrieval

This paper presents the results to evaluate the effectiveness of MPEG 7 color descriptors in visual surveillance retrieval problems. A set of image sequences of pedestrians entering and leaving a room, viewed by two cameras, is used to create a test set. The problem posed is the correct identification of other sequences showing the same person as contained in an example image. Color descriptors from the MPEG7 standard are used, including dominant color, color layout, color structure and scalable color experiments are presented that compare the performance of these, and also compare automatic and manual techniques to examine the sensitivity of the retrieval rate on segmentation accuracy. In addition, results are presented on innovative methods to combine the output from different descriptors, and also different components of the observed people. The evaluation measure used is the ANMRR, a standard in content-based retrieval experiments.