Multimodal sparse representation classification with Fisher discriminative sample reduction

This paper presents a method to perform sparse representation based classification (SRC) in a more accurate and efficient way. In this method, training data is first mapped into different feature spaces and multiple dictionaries are built by utilizing a Fisher discriminative based method. These dictionaries can be considered as efficient representations of the data which are then used in a multimodal SRC framework to classify test samples. In comparison to the original SRC method where only one modality of training space is utilized, the proposed method classifies test samples in a more accurate and efficient way. Experimental results from two different face datasets show that the proposed multimodal method has higher recognition rate compared to single-modality SRC based methods. The accuracy of the proposed method is also compared to other multi-modality classifiers and the results confirm that higher recognition rates are achieved in comparison with other common classification algorithms.