An Unsupervised Emotional Scene Retrieval Framework for Lifelog Videos

In order to promote the utilization of lifelog videos, an effective retrieval framework of the emotional scenes, which are considered to be important scenes, is proposed in this paper. The proposed method is based on facial expression recognition since the emotional scenes can be detected by taking the facial expressions into consideration. Most of conventional facial expression recognition methods require a large amount of training data to construct a recognition model. Adopting such methods for large-scale video databases is unrealistic because preparing sufficient training data requires considerable human efforts. We introduce an unsupervised machine learning framework to solve this issue by making it possible to construct a facial expression recognition model without any training data set. The proposed method is evaluated through an emotional scene detection experiment. A prototype of the emotional scene retrieval system based on the proposed emotional scene detection method is implemented.