Manipulation primitive analysis support system of state-based teaching by demonstration in VR - visualization and simulation of sensory events

"Teaching by demonstration" is a method to generate a robot program that makes a robot do the same task as the task that a human operator demonstrates. The authors has developed a "teaching by demonstration in VR" system (TbDinVR) which automatically generates a robot program to work in the real world after a task is demonstrated by an operator in the virtual world. In this paper, we have explained necessary and sufficient condition for states in a task description, advantages of using state-based TbDinVR system, and a simulator for determining parameters of skill primitives by using sensor simulation in VR and a random search technique. We have shown an experimental result and visualization of that result