Smart Audio/Video Playback Control Based on Presence Detection and User Localization in Home Environment

This paper presents the design and implementation of a simple software-based home control platform used for the automatic control of audio/video devices. The system facilitates integration of various residential sensors, with an accent on users´ localization and presence detection. For the presence detection and localization we utilize three, the most frequently used technologies: visual (3D camera), audio (Microphone array) and passive infrared (PIR sensors). The home controller interprets information about user´s position as a command issued to a list of UPnP/DLNA rendering devices (PC, TV or Audio system). Current distance and user´s position can activate, abort or change video presentation, pause and continue playback, amplify sound or silence it automatically with regard to information retrieved from sensors and actions described in a so-called ambient behavior patterns. The way the system automatically responds to detected positions is controllable and changeable, and it is defined by executing XML documents which represent the behavior patterns - scripts. By using the easily accessible user interface, users are able to choose one of the available scripts or to prepare a new one, and to set up different audio/video modes in a room, similarly to switching profiles on mobile phones. The system is not limited to presence detection and audio/video control. Performing simple modifications of behavior scripts, the controller can interpret data from different kinds of sensors in an unobtrusive way of controlling various home appliances.