Title :
Physics-Based Deformable Tongue Visualization
Author :
Yin Yang ; Xiaohu Guo ; Vick, J. ; Torres, Luis G. ; Campbell, T.F.
Author_Institution :
Dept. of Comput. Sci., Univ. of Texas at Dallas, Richardson, TX, USA
Abstract :
In this paper, a physics-based framework is presented to visualize the human tongue deformation. The tongue is modeled with the Finite Element Method (FEM) and driven by the motion capture data gathered during speech production. Several novel deformation visualization techniques are presented for in-depth data analysis and exploration. To reveal the hidden semantic information of the tongue deformation, we present a novel physics-based volume segmentation algorithm. This is accomplished by decomposing the tongue model into segments based on its deformation pattern with the computation of deformation subspaces and fitting the target deformation locally at each segment. In addition, the strain energy is utilized to provide an intuitive low-dimensional visualization for the high-dimensional sequential motion. Energy-interpolation-based morphing is also equipped to effectively highlight the subtle differences of the 3D deformed shapes without any visual occlusion. Our experimental results and analysis demonstrate the effectiveness of this framework. The proposed methods, though originally designed for the exploration of the tongue deformation, are also valid for general deformation analysis of other shapes.
Keywords :
data analysis; data visualisation; deformation; finite element analysis; image segmentation; interpolation; speech processing; 3D deformed shapes; FEM; deformation subspace computation; deformation visualization techniques; energy interpolation-based morphing; finite element method; hidden semantic information; high-dimensional sequential motion; human tongue deformation visualization; in-depth data analysis; intuitive low-dimensional visualization; local target deformation; motion capture data; physics-based deformable tongue visualization; physics-based framework; physics-based volume segmentation algorithm; speech production; strain energy; visual occlusion; Deformable models; Production; Sensors; Shape; Speech; Tongue; Visualization; Deformable model; finite element method; modal analysis; tongue; Algorithms; Biophysics; Computer Graphics; Computer Simulation; Elastic Modulus; Humans; Imaging, Three-Dimensional; Models, Biological; Movement; Reproducibility of Results; Sensitivity and Specificity; Speech; Tongue; User-Computer Interface;
Journal_Title :
Visualization and Computer Graphics, IEEE Transactions on
DOI :
10.1109/TVCG.2012.174