MP-FEG: Media Player controlled by Facial Expressions and Gestures

In this paper we represent a new technique to interact with the computer in a non-tangible way. Specifically we have designed a Media Player system controller by Facial Expressions and Gestures (MP-FEG). We detect and track one landmark point on the finger and 18 landmark points on the lips to capture the movement of the finger and the lips of the user. The movement patterns are classified into hand gestures and facial expressions using support vector machine (SVM). We have achieved ~98.65% and ~100% recognition accuracies for hand-gestures and facial expressions respectively. Occurrence of each of these actions (5 hand-gesturs and 3 facial expressions) is associated with a command to control (e.g., to select, play, pause the video) the video player. Perceptional quality analysis by user survey rates the experience of the non-tangible human-computer-interaction facilited by the proposed technique as `good´.