Title :
Conveying visual information with spatial auditory patterns
Author :
Wang, Zhiqian ; Ben-Arie, Jezekiel
Author_Institution :
Dept. of Electr. Eng. & Comput. Sci., Illinois Univ., Chicago, IL, USA
fDate :
11/1/1996 12:00:00 AM
Abstract :
Humans can perceive their spatial surroundings both by the visual and the auditory senses. Even though the auditory system has much lower spatial resolution, it can still serve as an alternative or supplementary information channel for the visual modality. We investigate the feasibility of conveying elaborate visual information by auditory patterns. A system is developed that transforms 2-D binary images into “auditory images.” Such images are based on slow raster scanning of a perceptual auditory surface around the subject while emitting sounds that correspond to the brightness level of the images at each location. The parameters involved in such a system are quantitatively investigated with respect to their effect on performance. These parameters include resolution, level difference, sound color contrast, speed, surface curvature, etc. The graphic percepts of synthetic auditory images that correspond to simple shapes are also analyzed. The experimental results show that sound localization can be used to convey visual information quite successfully for simple shapes and low-resolution patterns
Keywords :
acoustic signal processing; audio signals; brightness; hearing; image processing; signal resolution; 2D binary images; auditory image; auditory system; brightness level; experimental results; graphic percepts; information channel; level difference; low resolution patterns; perceptual auditory surface; slow raster scanning; sound color contrast; sound localization; spatial auditory patterns; spatial resolution; spatial surroundings; speed; surface curvature; synthetic auditory images; visual information; Auditory displays; Auditory system; Brightness; Computer displays; Frequency; Graphics; Image analysis; Shape; Spatial resolution; Vehicles;
Journal_Title :
Speech and Audio Processing, IEEE Transactions on