A step towards a multimodal AR interface: a new handheld device for 3D interaction

In this paper, we describe the AR Mask, a novel handheld augmented reality (AR) input and display device that not only provides support for a full range of traditional interaction techniques, but also facilitates new metaphors. Unlike other AR display and input technologies, our device consolidates input and output within a single piece of hardware. We demonstrate how this design provides a closed control loop between the user´s input modalities and natural sensory receptors.