Evaluating scene monitoring systems: a discussion paper

Scene monitoring systems are finding widespread application within the security market. The dominant share of the market is held by closed circuit TV (CCTV)-based systems. Techniques for evaluating CCTV-based systems are addressed. The systems, normally using imagery from CCTV cameras as their input, can range from simple movement detection equipment to very sophisticated intelligent scene analysis devices. Thought has been given to the issues which need to be addressed when evaluating such systems, as well as the various techniques which could be used. The authors review the thoughts of those involved. The view taken in evaluating scene monitoring systems has been to work closely with the potential end users of the systems to see how the systems perform in real life settings. Real-life scenes are seen as essential to the evaluation process as they contain such a wide range of changes. The implementation of a specific evaluation is described