DocumentCode
3272248
Title
Haptic and sound correlations: pitch, loudness and texture
Author
Peeva, Dessislava ; Baird, Bridget ; Izmirli, Ozgur ; Blevins, Donald
Author_Institution
Ammerman Center for Arts & Technol., Connecticut Coll., CT, USA
fYear
2004
fDate
14-16 July 2004
Firstpage
659
Lastpage
664
Abstract
People process information through multiple modalities and many studies have been done that show interaction among the auditory, haptic and visual modes. This paper reports on a correlation between the haptic property of roughness and each of the audio properties of pitch and loudness. There were four experiments: given a roughness, match a loudness level to it and vice versa and given a roughness, match a pitch to it and vice versa. Subjects showed a strong correlation in the first two experiments, associating louder sounds with rougher textures and softer sounds with smoother textures. They also showed, although not always in the same direction, a strong correlation between pitch (high/low) and roughness. Applications of this study are to multimodal user interfaces and to music cognition.
Keywords
acoustic signal processing; audio user interfaces; haptic interfaces; haptic correlation; loudness audio property; multimodal user interfaces; music cognition; pitch audio property; roughness haptic property; sound correlation; Application software; Art; Computer interfaces; Delay; Educational institutions; Fractals; Haptic interfaces; Rough surfaces; Speech synthesis; Surface roughness;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Visualisation, 2004. IV 2004. Proceedings. Eighth International Conference on
ISSN
1093-9547
Print_ISBN
0-7695-2177-0
Type
conf
DOI
10.1109/IV.2004.1320212
Filename
1320212
Link To Document