Title :
Emotionally aware automated portrait painting demonstration
Author :
Valstar, Michel F. ; Colton, Simon ; Pantic, Maja
Author_Institution :
Dept. of Comput., Imperial Coll. London, London
Abstract :
We propose to demonstrate the emotionally aware painting fool, a novel system that combines a machine vision system able to recognise emotions with a non-photorealistic rendering (NPR) system to automatically produce portraits of the sitter in an emotionally enhanced style. During the demonstration, the vision system records a short video clip of a person showing a basic emotion. The system then analyses this video clip, locating facial features and tracking their motion. Using this tracking data, the system analyses which emotion was expressed and what the temporal dynamics of the expression were. This information is then passed to the NPR software. The detected emotion is used to choose appropriate (simulated) art materials, colour palettes, abstraction methods and painting styles, so that the rendered image may heighten the emotion being expressed. The live demonstration shows how each element of the emotionally aware painting fool functions and produces a portrait in approximately 7 minutes.
Keywords :
art; computer vision; emotion recognition; image colour analysis; motion estimation; rendering (computer graphics); tracking; video signal processing; abstraction methods; colour palettes; emotion recognition; emotionally aware automated portrait painting demonstration; emotionally aware painting fool; facial features; machine vision system; motion tracking; non photorealistic rendering system; painting styles; video clip; Art; Color; Data analysis; Emotion recognition; Facial features; Machine vision; Motion analysis; Painting; Rendering (computer graphics); Tracking;
Conference_Titel :
Automatic Face & Gesture Recognition, 2008. FG '08. 8th IEEE International Conference on
Conference_Location :
Amsterdam
Print_ISBN :
978-1-4244-2153-4
Electronic_ISBN :
978-1-4244-2154-1
DOI :
10.1109/AFGR.2008.4813367