Title :
Registration based on projective reconstruction technique for augmented reality systems
Author :
Yuan, M.L. ; Ong, S.K. ; Nee, A.Y.C.
Author_Institution :
Singapore-MIT Alliance, Nat. Univ. of Singapore, Singapore
Abstract :
In AR systems, registration is one of the most difficult problems currently limiting their application. In this paper, we propose a simple registration method using projective reconstruction. This method consists of two steps: embedding and tracking. Embedding involves specifying four points to build the world coordinate system on which a virtual object will be superimposed. In tracking, a projective reconstruction technique is used to track these four specified points to compute the model view transformation for augmentation. This method is simple, as only four points need to be specified at the embedding stage and the virtual object can then be easily augmented onto a real scene from a video sequence. In addition, it can be extended to a scenario using the projective matrix that has been obtained from previous registration results using the same AR system. The proposed method has three advantages: 1) it is fast because the linear least square method can be used to estimate the related matrix in the algorithm and it is not necessary to calculate the fundamental matrix in the extended case. 2) A virtual object can still be superimposed on a related area even if some parts of the specified area are occluded during the whole process. 3) This method is robust because it remains effective even when not all the reference points are detected during the whole process, as long as at least six pairs of related reference points correspondences can be found. Some experiments have been conducted to validate the performance of the proposed method.
Keywords :
augmented reality; image reconstruction; image registration; image sequences; least squares approximations; augmented reality system; image registration; linear least square method; model view transformation; occlusion; projective reconstruction technique; real scene; tracking; video sequence; virtual object; Acoustic sensors; Application software; Augmented reality; Cameras; Computer vision; Image reconstruction; Layout; Magnetic sensors; Object detection; Video sequences; Index Terms- Augmented reality; projective reconstruction; registration; tracking.; Algorithms; Artificial Intelligence; Computer Graphics; Image Enhancement; Image Interpretation, Computer-Assisted; Imaging, Three-Dimensional; Information Storage and Retrieval; Numerical Analysis, Computer-Assisted; Pattern Recognition, Automated; Sensitivity and Specificity; Signal Processing, Computer-Assisted; Subtraction Technique; User-Computer Interface;
Journal_Title :
Visualization and Computer Graphics, IEEE Transactions on
DOI :
10.1109/TVCG.2005.48