Inertial sensor fusion for 3D camera tracking

It is well known in a Bayesian filtering framework, the use of inertial sensors such as accelerometers and gyroscopes improves 3D tracking performance compared to using camera measurements only. The performance improvement is more evident when the camera undergoes a high degree of motion. However, it is not well known whether the inertial sensors should be used as control inputs or as measurements. In this paper, we present the results of an extensive set of simulations comparing different combinations of using inertial sensors as control inputs or as measurements. We show that it is better use a gyroscope as a control input while an accelerometer can be used as a measurement or control input. We also derive and present the extended Kalman filter (EKF) equations for a specific case of fusing accelerometer and gyroscope data that has not been reported before.