Augmented Reality of Flexible Surface with Realistic Lighting

In this study we augmented a virtual object to an image of a flexible surface such as a paper, which is acquired from a web camera. To get more presence feeling, we consider realistic illumination on augmenting. To get the geometric relation between the camera and the flexible surface, we use markers that are printed on the surface. Using marker information in prior, three dimensional coordinates of the surface can be calculated. After the marker is removed from the input image, we attach a two dimensional texture and shadow to the flexible surface by considering realistic illumination.