Title :
Discriminative Fusion Approach for Automatic Image Annotation
Author :
Wang, De-Hong ; Gao, Sheng ; Tian, Qi ; Sung, Wing-Kin
Author_Institution :
Inst. of Infocomm Res., Singapore
fDate :
Oct. 30 2005-Nov. 2 2005
Abstract :
In this paper, two discriminative fusion schemes are proposed for automatic image annotation. One is the ensemble-pattern association based fusion and another is the model-based transformation. The fusion approaches are studied and evaluated in a unified framework for AIA based on the text representation of the image content and the MC MFoM learning. The schemes are flexible for fusing diverse visual features and multiple modalities. The discriminative learning can automatically weight the most important features for the classification. We evaluate the fusion schemes based on the Corel and TRECVID 2003 datasets. The experimental results clearly show that the proposed fusion schemes give a significant improvement in term of the mean of F1 as well as the number of the detected concepts
Keywords :
feature extraction; image classification; image fusion; image representation; text analysis; AIA; Corel; MC MFoM learning; TRECVID 2003 datasets; automatic image annotation; discriminative fusion approach; diverse visual features; ensemble-pattern association; model-based transformation; multicategory maximum figure-of-merit approach; multiple modality; text representation; Concatenated codes; Content based retrieval; Fuses; Image retrieval; Information retrieval; Minimization methods; Robustness; Shape; Speech; System performance; discriminative fusion; image annotation; maximum figure of merit;
Conference_Titel :
Multimedia Signal Processing, 2005 IEEE 7th Workshop on
Conference_Location :
Shanghai
Print_ISBN :
0-7803-9288-4
Electronic_ISBN :
0-7803-9289-2
DOI :
10.1109/MMSP.2005.248595