Artificial synesthesia via sonification: a wearable augmented sensory system

A design for an implemented, prototype wearable artificial sensory system is presented which uses data sonification to compensate for normal limitations in the human visual system. The system gives insight into the complete visible-light spectra from objects being seen by the user; long-term wear and consequent training might lead to identification of various visually-indistinguishable materials based on the sounds of their spectra. A system design is presented, and some possible extensions to both the sonification and the sensor package are discussed.