Title :
Navigational 3D audio-based game-training towards rich auditory spatial representation of the environment
Author :
Balan, Oana ; Moldoveanu, Alin ; Moldoveanu, Florica ; Dascalu, Maria-Iuliana
Author_Institution :
Fac. of Autom. Control & Comput., Univ. Politeh. of Bucharest, Bucharest, Romania
Abstract :
As the number of people suffering from visual impairments continuously increases, there is strong need for efficient sensory substitution devices, that can support creating a rich mental spatial depiction of the environment. The use of the auditory sense has proved to be an effective approach towards creating a method of interaction with the elements of the surrounding space in a way which resembles the natural 3D visual representation of normal sighted people. Training is an essential component in the process of employing an auditory-based visual substitution device for blind people, as it helps them to learn and become proficient to process and decode the audio information and convert it into spatial mental representation. Taking into account the well-known advantages of game based learning, we propose a new method of training, consisting in a navigational 3D audio-based game. In this exploratory, goal-directed application, the player has to perform route-navigational tasks under different conditions, with the purpose of training and testing their orientation and mobility skills, relying exclusively on the perception of 3D audio cues. Experimental results showed that this game-based learning strategy leads to substantial improvements and can be a starting point for developing more enhanced sound-based navigational applications. The ludic-oriented, motivational training approach achieved straightforward immersion and concentration on the cognitive depiction of the environment, ensuring behavioral gains in the sound-directed spatial orientation.
Keywords :
acoustic signal processing; audio coding; cognition; computer based training; computer games; handicapped aids; hearing; signal representation; 3D audio cues perception; audio information decode; auditory sense; auditory spatial representation; auditory-based visual substitution device; behavioral gains; blind people; cognitive depiction; game based learning; goal-directed application; ludic-oriented motivational training approach; mental spatial depiction; mobility skills; natural 3D visual representation; navigational 3D audio-based game-training; normal sighted people; orientation skills; route-navigational tasks; sensory substitution devices; sound-based navigational applications; sound-directed spatial orientation; spatial mental representation; visual impairments; Auditory system; Games; Navigation; Sonification; Three-dimensional displays; Training; Visualization; 3D binaural sound; HRTF; Sensory Substitution Device; Virtual Auditory Display; audio game; neuroplasticity;
Conference_Titel :
System Theory, Control and Computing (ICSTCC), 2014 18th International Conference
Conference_Location :
Sinaia
DOI :
10.1109/ICSTCC.2014.6982496