Automated rig removal with Bayesian motion interpolation

Some of the most convincing film and video effects are created in digital post-production by removing apparatus that supports or manipulates actors and objects. Wires, cranes and other objects can be removed by digitally painting them out of the scene provided that some ´clean plate´ image is available for pasting in the missing regions. The problem of when no such plate is available is addressed. Provided that the undesired object (the rig) is moving, it is possible to use the motion throughout the sequence to reconstruct automatically the image material that was obscured. The paper takes a novel approach that allows the estimation of the motion of the material beneath the rig and then reconstruction of the missing image material. A Bayesian framework is used to solve the motion reconstruction problem, and a unique tool is developed for automated rig removal. This tool holds great potential for speeding up one of the major tasks performed in the effects industry and is currently being tested in that environment.