Interface for non-haptic control in automation

The approach extends control principles of standard building automation. Introducing control commands based on information from 3D head pose estimation and tracking systems, new methods in communication and contactless controlled systems are made accomplishable. Using a visual user-interface, visually detected movements can be transformed into standard control commands. Using a defined markup language, an application dependent command set is correlated with actual head movements. The mapping itself can be adapted to application dependent demands and the individual needs of the users. The concept of “visual control” is intended to be a further step towards bridging the information gap between (physically challenged) people and their smart environments. The concept is applied to a prototype used in different settings of a building automation, utilising cutting-edge software with standard control devices and sensors.