Illumination mipmaps for texture mapping in computational video

In computational video, acquired images are often texture mapped to blend with computer generated polygonal surfaces. The shading of a polygonal surface changes as the light source direction relative to the composite object changes due, for instance, to the object´s motion. We propose the use of so-called illumination mipmaps that can adjust the texture mapped image according to the illumination change so that the appearance of the composite object is more cohesive. We test our concept on texture mapped images of human faces.