Recognition of visual signals and firing positions for virtual military training systems

In this paper, we present visual hand and arm signals recognition and rifle firing positions estimation for virtual military training systems which perform various military tasks in the virtual environments. Among them, we deal with the platoon leader training and rifle firing position training for various military situations. In the platoon leader training, the trainee whose role is a platoon leader keeps command and control over his/her members by visual signals. The proposed visual signals and rifle firing positions recognition system exploits the optical motion capture system. For the real-time performance, our recognition method localizes the head and hands in the user-centered partitions of 3D space and analyzes their temporal transitions, and finally makes a simple decision to classify the visual hand and arm signals. Experimental results show the evaluation of the proposed method.