Dark Matter Method for Correct Augmented Reality Occlusion Relationships

In augmented reality (AR), virtual objects are rendered to appear to co-exist with a real scene and real objects. Usually augmentations are simply drawn over top of the camera image, which does not work for cases where the virtual object should be partially or completely occluded by real objects in the scene. A solution is proposed where a virtual object that approximates the shape of the real object provides the correct occlusion relationship but is not drawn to the output image, an approach useful to both real time AR and off-line movie effects. This "dark matter" method is used in a "magic mirror" AR system