• DocumentCode
    3272248
  • Title

    Haptic and sound correlations: pitch, loudness and texture

  • Author

    Peeva, Dessislava ; Baird, Bridget ; Izmirli, Ozgur ; Blevins, Donald

  • Author_Institution
    Ammerman Center for Arts & Technol., Connecticut Coll., CT, USA
  • fYear
    2004
  • fDate
    14-16 July 2004
  • Firstpage
    659
  • Lastpage
    664
  • Abstract
    People process information through multiple modalities and many studies have been done that show interaction among the auditory, haptic and visual modes. This paper reports on a correlation between the haptic property of roughness and each of the audio properties of pitch and loudness. There were four experiments: given a roughness, match a loudness level to it and vice versa and given a roughness, match a pitch to it and vice versa. Subjects showed a strong correlation in the first two experiments, associating louder sounds with rougher textures and softer sounds with smoother textures. They also showed, although not always in the same direction, a strong correlation between pitch (high/low) and roughness. Applications of this study are to multimodal user interfaces and to music cognition.
  • Keywords
    acoustic signal processing; audio user interfaces; haptic interfaces; haptic correlation; loudness audio property; multimodal user interfaces; music cognition; pitch audio property; roughness haptic property; sound correlation; Application software; Art; Computer interfaces; Delay; Educational institutions; Fractals; Haptic interfaces; Rough surfaces; Speech synthesis; Surface roughness;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Visualisation, 2004. IV 2004. Proceedings. Eighth International Conference on
  • ISSN
    1093-9547
  • Print_ISBN
    0-7695-2177-0
  • Type

    conf

  • DOI
    10.1109/IV.2004.1320212
  • Filename
    1320212