DocumentCode :
1467753
Title :
Conveying visual information with spatial auditory patterns
Author :
Wang, Zhiqian ; Ben-Arie, Jezekiel
Author_Institution :
Dept. of Electr. Eng. & Comput. Sci., Illinois Univ., Chicago, IL, USA
Volume :
4
Issue :
6
fYear :
1996
fDate :
11/1/1996 12:00:00 AM
Firstpage :
446
Lastpage :
455
Abstract :
Humans can perceive their spatial surroundings both by the visual and the auditory senses. Even though the auditory system has much lower spatial resolution, it can still serve as an alternative or supplementary information channel for the visual modality. We investigate the feasibility of conveying elaborate visual information by auditory patterns. A system is developed that transforms 2-D binary images into “auditory images.” Such images are based on slow raster scanning of a perceptual auditory surface around the subject while emitting sounds that correspond to the brightness level of the images at each location. The parameters involved in such a system are quantitatively investigated with respect to their effect on performance. These parameters include resolution, level difference, sound color contrast, speed, surface curvature, etc. The graphic percepts of synthetic auditory images that correspond to simple shapes are also analyzed. The experimental results show that sound localization can be used to convey visual information quite successfully for simple shapes and low-resolution patterns
Keywords :
acoustic signal processing; audio signals; brightness; hearing; image processing; signal resolution; 2D binary images; auditory image; auditory system; brightness level; experimental results; graphic percepts; information channel; level difference; low resolution patterns; perceptual auditory surface; slow raster scanning; sound color contrast; sound localization; spatial auditory patterns; spatial resolution; spatial surroundings; speed; surface curvature; synthetic auditory images; visual information; Auditory displays; Auditory system; Brightness; Computer displays; Frequency; Graphics; Image analysis; Shape; Spatial resolution; Vehicles;
fLanguage :
English
Journal_Title :
Speech and Audio Processing, IEEE Transactions on
Publisher :
ieee
ISSN :
1063-6676
Type :
jour
DOI :
10.1109/89.544529
Filename :
544529
Link To Document :
بازگشت