Joint photometric registration and optical flowestimation

This paper presents a method that estimates both the photometric mapping and the dense motion field in image sequences. The method extends the Horn-Schunck type dense variational optical flow estimation approach with the use of intensity mapping functions in an alternating optimization scheme. The intensity mapping functions are also updated through the iterations with the help of weighted histograms, where the weights reflect the visibility of pixels in one image from the other. We include experiments with both synthetic and real imagery to demonstrate the efficacy of the proposed method.