Gesture ontology for informing Service-oriented Architecture

We present a system engineering approach for designing Service-oriented Architectures (SOA) for software applications that use gesture commands. The approach employs ontology for gesture-based interaction which was designed on three levels: user execution, system implementation, and gesture reflection. The ontology borrows concepts from several research communities interested in gestures such as human-computer interaction, pattern recognition, and cognitive psychology. We show how the ontology can be used in order to inform the design of Service-oriented Architectures for engineering new systems and applications and describe a software architecture design for controlling smart homes with gesture commands.