• DocumentCode
    145409
  • Title

    P-HRTF: Efficient personalized HRTF computation for high-fidelity spatial sound

  • Author

    Meshram, Alok ; Mehra, Rajesh ; Hongsheng Yang ; Dunn, Enrique ; Franm, Jan-Michael ; Manocha, Dinesh

  • Author_Institution
    Dept. of Comput. Sci., Univ. of North Carolina, Chapel Hill, NC, USA
  • fYear
    2014
  • fDate
    10-12 Sept. 2014
  • Firstpage
    53
  • Lastpage
    61
  • Abstract
    Accurate rendering of 3D spatial audio for interactive virtual auditory displays requires the use of personalized head-related transfer functions (HRTFs). We present a new approach to compute personalized HRTFs for any individual using a method that combines state-of-the-art image-based 3D modeling with an efficient numerical simulation pipeline. Our 3D modeling framework enables capture of the listener´s head and torso using consumer-grade digital cameras to estimate a high-resolution non-parametric surface representation of the head, including the extended vicinity of the listener´s ear. We leverage sparse structure from motion and dense surface reconstruction techniques to generate a 3D mesh. This mesh is used as input to a numeric sound propagation solver, which uses acoustic reciprocity and Kirchhoff surface integral representation to efficiently compute an individual´s personalized HRTF. The overall computation takes tens of minutes on multi-core desktop machine. We have used our approach to compute the personalized HRTFs of few individuals, and we present our preliminary evaluation here. To the best of our knowledge, this is the first commodity technique that can be used to compute personalized HRTFs in a lab or home setting.
  • Keywords
    image motion analysis; image reconstruction; image representation; multiprocessing systems; numerical analysis; rendering (computer graphics); solid modelling; 3D mesh generation; 3D spatial audio rendering; Kirchhoff surface integral representation; P-HRTF; acoustic reciprocity; commodity technique; dense surface reconstruction technique; high-fidelity spatial sound; image-based 3D modeling; interactive virtual auditory displays; multicore desktop machine; nonparametric surface representation; numeric sound propagation solver; numerical simulation pipeline; personalized head-related transfer functions; sparse structure from motion technique; Computational modeling; Ear; Numerical models; Pipelines; Solid modeling; Three-dimensional displays;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Mixed and Augmented Reality (ISMAR), 2014 IEEE International Symposium on
  • Conference_Location
    Munich
  • Type

    conf

  • DOI
    10.1109/ISMAR.2014.6948409
  • Filename
    6948409