Learning spatial weighting via quadratic programming for facial expression analysis

Facial expression analysis is essential for human-computer interface (HCI). For different expressions, different parts of the face play different roles with the distinct movement of facial muscles. In this work, we propose to learn the weight associated with different facial regions for different expressions. The facial feature points are first located accurately based on a graphical model. Based on using the optical flow to represent the facial motion information due to expression, a quadratic programming problem is formulated to learn the optimal spatial weighting from training data such that faces of the same expression category are closer than those of different categories in the weighted optical flow space. We demonstrate the advantages of applying the learned weight to facial expression recognition and intensity estimation through experiments on several well-known facial expression databases.