Poster: Prototyping natural interactions in virtual studio environments by demonstrationby - Combining spatial mapping with gesture following

In this work, a rapid prototyping approach for natural real-time interactions in virtual studio environments was used, in order to facilitate the creation of an interactive virtual robotic arm, that could be controlled by hand movements in a natural manner. The approach focuses on tracking a person and manipulating control parameters as a way of steering interactions. It has two main aspects. The first one is the authoring of spatial relationships between the person and the virtual environment. The second aspect is the use of gesture following to synchronize various animations or event sequences inside the virtual environment to the corresponding person´s movements. Both aspects allow for a programming-by-demonstration approach and, combined, enable developers to rapidly create interactions by providing examples directly inside the blue or green box of the virtual studio.