An image mosaicing approach for video sequences based on space-time manifolds

In order to utilize the repetitive information among the video sequence more reasonably, this paper proposes an image mosaicing approach based on space-time manifolds for the video sequence taking the properties of high-overlapped ratio between neighbor frames and multiple frames into account. Firstly, we iterate Lucas-Kanade optical flow under Gaussian pyramid strategy to compute the motion parameters between neighbor frames with higher accuracy and align the sequence, in the meantime, eliminate the brightness difference among the neighbors combining with the result of motion computation, and then stitch together the whole sequence whose brightness is already uniform into a high resolution image using the space-time manifolds mosaicing technique. It was verified by the experiment that the proposed approach was very effective to video sequences and the mosaicing result was nice.