Smart cameras: 2D affine models for robust person recognition in consumer images

In this paper we consider how next generation smart cameras will move beyond face detection and tracking to develop more useful analysis tools for determining the expression and emotions of the subjects in images. An initial proof-of-concept using an active appearance model (AAM) to perform face recognition which is robust to pose and illumination variations is presented. Our initial results are very encouraging and suggest that the incorporation of a specialized AAM within next generation digital cameras will enable more accurate management and sorting of personal image collections based on the actual persons in the images.