DocumentCode
145409
Title
P-HRTF: Efficient personalized HRTF computation for high-fidelity spatial sound
Author
Meshram, Alok ; Mehra, Rajesh ; Hongsheng Yang ; Dunn, Enrique ; Franm, Jan-Michael ; Manocha, Dinesh
Author_Institution
Dept. of Comput. Sci., Univ. of North Carolina, Chapel Hill, NC, USA
fYear
2014
fDate
10-12 Sept. 2014
Firstpage
53
Lastpage
61
Abstract
Accurate rendering of 3D spatial audio for interactive virtual auditory displays requires the use of personalized head-related transfer functions (HRTFs). We present a new approach to compute personalized HRTFs for any individual using a method that combines state-of-the-art image-based 3D modeling with an efficient numerical simulation pipeline. Our 3D modeling framework enables capture of the listener´s head and torso using consumer-grade digital cameras to estimate a high-resolution non-parametric surface representation of the head, including the extended vicinity of the listener´s ear. We leverage sparse structure from motion and dense surface reconstruction techniques to generate a 3D mesh. This mesh is used as input to a numeric sound propagation solver, which uses acoustic reciprocity and Kirchhoff surface integral representation to efficiently compute an individual´s personalized HRTF. The overall computation takes tens of minutes on multi-core desktop machine. We have used our approach to compute the personalized HRTFs of few individuals, and we present our preliminary evaluation here. To the best of our knowledge, this is the first commodity technique that can be used to compute personalized HRTFs in a lab or home setting.
Keywords
image motion analysis; image reconstruction; image representation; multiprocessing systems; numerical analysis; rendering (computer graphics); solid modelling; 3D mesh generation; 3D spatial audio rendering; Kirchhoff surface integral representation; P-HRTF; acoustic reciprocity; commodity technique; dense surface reconstruction technique; high-fidelity spatial sound; image-based 3D modeling; interactive virtual auditory displays; multicore desktop machine; nonparametric surface representation; numeric sound propagation solver; numerical simulation pipeline; personalized head-related transfer functions; sparse structure from motion technique; Computational modeling; Ear; Numerical models; Pipelines; Solid modeling; Three-dimensional displays;
fLanguage
English
Publisher
ieee
Conference_Titel
Mixed and Augmented Reality (ISMAR), 2014 IEEE International Symposium on
Conference_Location
Munich
Type
conf
DOI
10.1109/ISMAR.2014.6948409
Filename
6948409
Link To Document