Homography-based plane identification and matching

In this paper, we propose a new approach for extracting major planes of the scene from uncalibrated pairs of images. In contrast to existing methods, our method does not make any assumption on the images or co-planarity of points. The proposed method takes two uncalibrated images as input, extracts and matches interest points, and then performs plane identification and matching defined by sets of three points. For each set of three points, a plane homography is then calculated. Once all possible planes have been identified, a merging stage is carried out to improve the robustness and to make sure that same planes are associated with a single homography. Furthermore, the method is capable to distinguish between physical and virtual planes. Experiments on a variety of real images demonstrate the validity of the proposed approach.