SRP Based Natural Interaction between Real and Virtual Worlds in Augmented Reality

In current video see-through augmented reality system, natural interaction between real and virtual worlds is impossible. We analyze its cause and propose a new mode which is named mix before projection to combine real and virtual worlds for AR. Under this framework, we develop a tool named space registration particle (SRP) and speed multi-pass GPU algorithms to retrieve the pre-projection real world so as to achieve the natural interaction between real and virtual worlds in real time. The correctness of this method is proven by experiments based on our algorithms and theorem-proof of SRP Theorem in this paper. Experiments results and discussion about the experiments are also given.