Research on the application of gesture in virtual maintenance

This paper presents a method of gesture recognition based on Leap Motion controller in the virtual maintenance training system. In order to realize the real action of the hand in the maintenance, we establish virtual hand model by combining the characteristics of Leap Motion device. The virtual hand model includes the use of the tool to enhance the diversity of maintenance actions. We analyze the characteristics of various hand actions in maintenance operations and give a simplified model of the gesture which is presented for real-time interaction. The effectiveness of the model is demonstrated through an example of gun in 3D virtual maintenance scene on PC.