Simulation and graphical interface for programming and visualization of sensor-based robot operation

The authors describe a simulation environment which can be of utility in the design, development, and operation of sensor-driven robotic systems. This environment incorporates the ability to simulate sensory inputs and their effects on the planning and control functions. A detailed design of the simulator is presented. The simulator is integrated within an entire robotic system, and is utilized for automatic robot programming. Alternatively, the simulated system operation flow can be controlled through either a teach mode or a program mode. Five sensing modalities can be simulated: proximity, point laser range, ultrasonic range, laser range depth imagery, and edge-based intensity imagery. The simulation and animation of a particular robot is described. The unique features of the simulator are that it simulates and utilizes sensory information feedback, it integrates planning and simulation, and it makes the switching between real and simulation mode in the robotic system transparent to the user