DocumentCode :
3605504
Title :
Heterogeneous Feature Selection With Multi-Modal Deep Neural Networks and Sparse Group LASSO
Author :
Lei Zhao ; Qinghua Hu ; Wenwu Wang
Author_Institution :
Sch. of Comput. Sci. & Technol., Tianjin Univ., Tianjin, China
Volume :
17
Issue :
11
fYear :
2015
Firstpage :
1936
Lastpage :
1948
Abstract :
Heterogeneous feature representations are widely used in machine learning and pattern recognition, especially for multimedia analysis. The multi-modal, often also high- dimensional , features may contain redundant and irrelevant information that can deteriorate the performance of modeling in classification. It is a challenging problem to select the informative features for a given task from the redundant and heterogeneous feature groups. In this paper, we propose a novel framework to address this problem. This framework is composed of two modules, namely, multi-modal deep neural networks and feature selection with sparse group LASSO. Given diverse groups of discriminative features, the proposed technique first converts the multi-modal data into a unified representation with different branches of the multi-modal deep neural networks. Then, through solving a sparse group LASSO problem, the feature selection component is used to derive a weight vector to indicate the importance of the feature groups. Finally, the feature groups with large weights are considered more relevant and hence are selected. We evaluate our framework on three image classification datasets. Experimental results show that the proposed approach is effective in selecting the relevant feature groups and achieves competitive classification performance as compared with several recent baseline methods.
Keywords :
feature extraction; feature selection; image classification; image representation; learning (artificial intelligence); neural nets; discriminative features; feature groups; heterogeneous feature representations; heterogeneous feature selection; high-dimensional features; image classification datasets; informative feature selection; multimodal deep-neural networks; redundant heterogeneous feature groups; redundant irrelevant information; sparse group LASSO problem; unified representation; weight vector; Data mining; Feature extraction; Kernel; Machine learning; Multimedia communication; Neural networks; Deep learning; feature selection; heterogeneous data; multi-modal; sparse representation;
fLanguage :
English
Journal_Title :
Multimedia, IEEE Transactions on
Publisher :
ieee
ISSN :
1520-9210
Type :
jour
DOI :
10.1109/TMM.2015.2477058
Filename :
7244241
Link To Document :
بازگشت