Abnormal event detection using multimedia information for monitoring system

The health smart home has been become an attractive domain for both research and industrial. One of the main issues in smart home is abnormal event detection that allows alarming and making assistance as soon as possible. In this paper, we analyze and exploit multimedia information (image and audio) to resolve the problem of abnormal event detection. The interested abnormal events of our study include falling, lying motionless on the floor, staying in rest room, being out door in long time, abnormal speech (e.g. screaming, shouting) and abnormal non-speech (e.g. breaking and falling sounds). The experimental results evaluated by false alarm rate and sensitivity show that audio and image information complement each other and the use of both information allows detecting a large number of interested abnormal events which can be used in monitoring system for healthcare application.