Real-time 2D+3D facial action and expression recognition

This paper presents a completely automated facial action and facial expression recognition system using 2 D + 3 D images recorded in real-time by a structured light sensor. It is based on local feature tracking and rule-based classification of geometric, appearance and surface curvature measurements. Several experiments conducted under relatively non-controlled conditions demonstrate the accuracy and robustness of the approach.