Title :
Multi-modal Fusion based on classifiers using reject options and Markov Fusion Networks
Author :
Glodek, Michael ; Schels, Martin ; Palm, Gunther ; Schwenker, Friedhelm
Author_Institution :
Inst. of Neural Inf. Process., Ulm Univ., Ulm, Germany
Abstract :
Classifying continuous signals from multiple channels poses several challenges: different sample rates from different types of channels have to be incorporated. Furthermore, when leaping from the laboratory to the real world, it is mandatory to deal with failing sensors and also uncertain or even incorrect classifications. We propose a new Multi Classifier System (MCS) based on the application of classifier making use of an reject option and a Markov Fusion Network (MFN) which is evaluated in an off-line and on-line manner. The architecture is tested using the publicly available AVEC corpus, that collects affectively labeled episodes of human computer interaction. The MCS achieved a significant improvement compared to the results obtained on the single modalities.
Keywords :
Markov processes; audio signal processing; human computer interaction; image classification; image fusion; video signal processing; AVEC corpus; MCS; MFN; Markov fusion networks; continuous signal classification; failing sensors; human computer interaction; multiclassifier system; multimodal fusion; multiple channels poses; reject options; sample rates; Computer architecture; Emotion recognition; Face recognition; Human computer interaction; Markov processes; Sensors; Vectors;
Conference_Titel :
Pattern Recognition (ICPR), 2012 21st International Conference on
Conference_Location :
Tsukuba
Print_ISBN :
978-1-4673-2216-4