Integrated Pipeline for Natural Interaction with Photorealistic Rendering

This work presents an interface for virtual objects manipulation through hand gestures. The main purpose is to provide a faithful metaphor of reality by merging the concepts of augmented reality, photo realistic rendering and natural interaction. In order to accomplish this goal, both RGB and depth image from Kinect are considered for rendering and hand tracking. As a case study, an interactive application for manipulating and building compound objects structures through simple objects was implemented and tested, validating the proposed gestures as well as the interface presentation.