Utilising audio-visual stimuli in interactive information systems: a two domain investigation on auditory metaphors

The paper describes experiments that investigated the use of auditory stimuli (speech and non-speech sound) to communicate data in two information systems. These experiments were performed under a multimedia stock control system and a multimedia e-mail tool. Experiments using the multimedia stock control information system investigated rhythms and timbre to communicate windows and their associated functions as well as the simultaneous rise of speech and sound to communicate a large amount of information to users. Experiments using the multimedia e-mail tool investigated the use of tunes and short pitch sequences with visual stimuli to communicate information in browsing e-mail data. The paper also integrates experimental results front both systems and discusses the incorporation of auditory stimuli in interactive audio-visual or multimedia information systems. Auditory stimuli helped to communicate, complement or reinforce information that users received via the visual channel. These auditory technologies could also benefit visually impaired users of such systems. Results also indicated that the simultaneous use of sound and speech can be useful in the design of interactive multimedia information systems. The inclusion of auditory stimuli (including speech) in the design of information systems has the potential to maximise the volume of information communicated to users.