Research and design of the “Voice-Touch-Vision” Multimodal Integrated Voice Interaction in the Mobile Phone

With the continuous improvement of the functions of mobile phones, the human voice as the most natural way of communication has been drawn wide attention because of its convenience and accessibility. However, there exist some problems in the application of voice interactions. This paper analyses the current voice interaction, and induces three kinds of problems: accurate quantification, multiple choices, and accessory correction. In terms of the existing problems, this paper introduces a “Voice-Touch-Vision” Multimodal Integrated Voice Interaction (VTV-MIVI) concept. Based on VTV-MIVI, a linear & rotary touch model has been established to improve the accurate quantification of voice interaction. Finally, we applied the scheme in an immersive virtual driving game scene.