Development of an eye movement tracking type head mounted display: capturing and displaying real environment images with high reality

This paper describes the head mounted display (HMD) system which can capture and display images with high reality. Conventional HMD has the disadvantages of small screen size and low resolution. Therefore, the resolution is not high enough for telerobotics applications which need real environment images with high reality. In order to address these problems, an eye movement tracking type head mounted display (EMT-HMD) is being developed. The EMT-HMD can display wide viewing angle and high resolution images of the environment. The theory is that a small, high resolution image is displayed at view point of the operator and a wide, low resolution image is displayed at the periphery. Human can see an object as a high resolution image only near the view point. Therefore, the operator who wears the EMT-HMD can feel that the displayed image is wide view angle and high resolution. In this paper, an image capturing system of real environment images is discussed. Next, some evaluation experiments for displaying real environment images are introduced using an EMT-HMD system and an image capturing system