Title :
A 27 mW Reconfigurable Marker-Less Logarithmic Camera Pose Estimation Engine for Mobile Augmented Reality Processor
Author :
Injoon Hong ; Gyeonghoon Kim ; Youchang Kim ; Donghyun Kim ; Byeong-Gyu Nam ; Hoi-Jun Yoo
Author_Institution :
Dept. of Electr. Eng., Korea Adv. Inst. of Sci. & Technol., Daejeon, South Korea
Abstract :
A marker-less camera pose estimation engine (CPEE) with reconfigurable logarithmic SIMD processor is proposed for the view angle estimation used in mobile augmented reality (AR) applications. Compared to previous marker-based approach, marker-less camera pose estimation can overlay virtual images directly on natural world without the help of markers. However, they require 150× larger computing costs and large power consuming floating-point operations where such requirement severely restricts real-time operations and low-power implementations in mobile platform, respectively. To overcome the gap in computational costs between marker-based and marker-less method, speculative execution (SE) and reconfigurable data-arrangement layer (RDL) are proposed to reduce computing time by 17% and 27%, respectively. For low-power implementation of floating-point units, logarithmic processing element (LPE) is designed to reduce overall power consumption by 18%. The proposed marker-less CPEE is fabricated in 65 nm Logic CMOS technology, and successfully realizes real-time marker-less camera pose estimation with only 27 mW power consumption.
Keywords :
augmented reality; mobile computing; pose estimation; real-time systems; CPEE; logarithmic processing element; low-power implementations; marker-less logarithmic camera pose estimation engine; mobile augmented reality processor; real-time operations; reconfigurable data-arrangement layer; reconfigurable logarithmic SIMD processor; speculative execution; view angle estimation; virtual images; Cameras; Estimation; Feature extraction; Instruction sets; Jacobian matrices; Real-time systems; Three-dimensional displays; Augmented reality; bundle adjustment; feature matching; inter-frame similarity; logarithmic processing element; marker-less camera pose estimation; reconfigurable matrix accelerator;
Journal_Title :
Solid-State Circuits, IEEE Journal of
DOI :
10.1109/JSSC.2015.2463074