A substation virtual environment based on motion capture

In the immersive transformer training simulator, with inertia motion capture system, the operator´s motion data was captured and analyzed. The motions capture data of hand movements and gesture recognition algorithm were studied. A method of continuous space-time tracking of the hand joints was realized using skeleton graph. The hand movement features of natural human-machine interaction were defined. A method of hand segmentation from the depth graph background using hand joints of skeleton graph was proposed. Three kinds of gesture recognition method were realized with SVM and studied about stability and robustness. Semantics of gesture, mapped to virtual environments input events. The immersive transformer training simulator was realized based on the research.