Fusion Mappings for Multimodal Affect Recognition

Affect recognition is an inherently multi-modal task that makes it appealing to investigate classifier combination approaches in real world scenarios. Thus a variety of different independent classifiers can be constructed from basically independent features without having to rely on artificial feature views. In this paper we study a large variety of fusion approaches based on a multitude of features that were extracted from audio, video and physiological signals. For this purpose the RECOLA data collection is used and we show how an ensemble of classifiers can outperform the best individual classifier.