Surveillance system based on data fusion from image and acoustic array sensors

The present publication shows a model of a monitoring system of high benefit, based on two complementary sensorial systems (image+acoustics), which allows the information received to fuse, and to prioritize the computational resources toward the zones with considerable risk. The application uses components such as: active acoustic radar based on a phase array of microphones, with techniques of beamforming, and multibeam detection schemes; efficient compression algorithms and video transmission in real time. The system is composed of an arbitrary number of sensors (monitoring probes), distributed by the monitoring space, a data network and a central server (monitoring manager). The sensors consist of a microprocessor, with its memory and three main modules: (1) acoustic radar; (2) video capture card; and (3) network card. The flexibility of the system allows new modules to be added such as: personal detector card; sound card; cards for telecontrol; etc. The sensor microprocessor preprocesses the information received by the modules, packs and transmits it to the central server through a data network. The system uses IP protocol, and SNMPv2 for management