Simple augmented reality system for 3D ultrasonic image by see-through HMD and single camera and marker combination

Thanks to the rapid progress of ICT, significant progress has been made in both the “generation” and “display” of the advanced medical information. However, serious problems still remain in both the “generation” and “display”. Therefore, we propose a simple augmented reality system that can display an ultrasonic image of exactly the same plane in the body of the patient that a doctor is looking at. The key idea is to utilize the fact that an ultrasonic probe moves inside the doctor´s field of view and within the accessible range of the arm in order to simplify the augmented reality system. The prototype has been developed using only a see-through HMD and single camera and marker combination. Three simple interaction methods compensate for the limitations in 3D position sensing. We worked with a medical doctor to test the prototype system and found it to be effective.