A lattice framework for integrating vision modules

How information processing by individual modules such as stereopsis, motion, texture, and color modules may be integrated, or assimilated, is addressed. A framework for assimilation based on a partial ordering of constraints implicit in all active modules is proposed. Such constraints, for example the rigidity constraint for motion, although often robust are also fallible, and hence are more properly regarded as premises. Such premises are used to construct a preference ordering for (classes of) interpretations of the image. Interpretations associated with maximal states in the ordering are taken as the assimilated interpretation of the modules. This approach stresses the need to use world knowledge to reason about the plausibility and consistency of interpretations of the image data