Title :
Virtual experiment system for electrician training based on Kinect and Unity3D
Author :
Hongjian Liao ; Zhe Qu
Author_Institution :
Lab. Center, Guangzhou Univ., Guangzhou, China
Abstract :
In order to establish low-cost and strongly-immersive desktop virtual experiment system, a solution based on Kinect and Unity3D engine technology was herein proposed, with a view to applying Kinect gesture recognition and triggering more spontaneous human-computer interactions in three-dimensional virtual environment. A kind of algorithm tailored to the detection of concave-convex points of fingers is put forward to identify various gestures and interaction semantics. In the context of Unity3D, Finite-State Machine (FSM) programming was applied in intelligent management for experimental logic tasks. A “Virtual Experiment System for Electrician Training” was designed and put into practice by these methods. The applications of “Lighting Circuit” module prove that these methods can be satisfyingly helpful to complete virtual experimental tasks and improve user experience. Compared with traditional WIMP interaction, Kinect somatosensory interaction is combined with Unity3D so that three-dimensional virtual system with strong immersion can be established.
Keywords :
computer based training; electrical engineering computing; electrical engineering education; finite state machines; gesture recognition; human computer interaction; image sensors; virtual reality; FSM programming; Kinect gesture recognition; Kinect technology; Unity3D engine technology; concave-convex point detection; desktop virtual experiment system; electrician training; experimental logic task; finite state machine; human-computer interaction; interaction semantics; lighting circuit module; three-dimensional virtual system; user experience; Electric breakdown; Electron tubes; Electronic ballasts; Fluorescent lamps; Programming; Switches; Kinect; Unity 3D; electrician training; gesture interaction; virtual experiment system;
Conference_Titel :
Mechatronic Sciences, Electric Engineering and Computer (MEC), Proceedings 2013 International Conference on
Conference_Location :
Shengyang
Print_ISBN :
978-1-4799-2564-3
DOI :
10.1109/MEC.2013.6885480