MetaMorphs: Deformable shape and texture models

We present a new class of deformable models, MetaMorphs, that consist of both shape and interior texture. The model deformations are derived from both boundary and region information in a common variational framework. This framework represents a generalization of previous model-based segmentation approaches. The shapes of the new models are represented implicitly as "images" in the higher dimensional space of distance transforms. The interior textures are captured using a nonparametric kernel-based approximation of the intensity probability density functions (p.d.f.s) inside the models. The deformations that MetaMorph models can undergo are defined using a space warping technique - the cubic B-spline based Free Form Deformations (FFD). When using the models for boundary finding in images, we derive the model dynamics from an energy functional consisting of both edge energy terms and intensity/texture energy terms. This way, the models deform wider the influence of forces derived from both boundary and regional information. The proposed MetaMorph deformable models are efficient in convergence, have large attraction range, and are robust to image noise and inhomogeities. Various examples on finding object boundaries in noisy images with complex textures demonstrate the potential of the proposed technique.