Title :
Learning image Vicept description via mixed-norm regularization for large scale semantic image search
Author :
Li, Liang ; Jiang, Shuqiang ; Huang, Qingming
Author_Institution :
Key Lab. of Intell. Inf. Process., CAS, China
Abstract :
The paradox of visual polysemia and concept polymorphism has been a great challenge in the large scale semantic image search. To address this problem, our paper proposes a new method to generate image Vicept representation. Vicept characterizes the membership distribution between elementary visual appearances and semantic concepts, and forms a hierarchical representation of image semantic from local to global. To obtain discriminative Vicept descriptions with structural sparsity, we adopt mixed-norm regularization in the optimization problem for learning the concept membership distribution of visual word. Furthermore, considering the structure of BOV in images, visual descriptor is encoded as a weighted sum of dictionary elements using group sparse coding, which could obtain sparse representation at the image level. The wide applications of Vicept are validated in our experiments, including large scale semantic image search, image annotation, and semantic image re-ranking.
Keywords :
image representation; image retrieval; learning (artificial intelligence); optimisation; search problems; sparse matrices; BOV; concept polymorphism; dictionary element; elementary visual appearance; hierarchical image representation; image Vicept description learning; image Vicept representation; image annotation; large scale semantic image search; membership distribution; mixed-norm regularization; optimization problem; semantic image reranking; sparse image representation; structural sparsity; visual descriptor; visual polysemia; Dictionaries; Encoding; Image coding; Image reconstruction; Optimization; Semantics; Visualization;
Conference_Titel :
Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on
Conference_Location :
Providence, RI
Print_ISBN :
978-1-4577-0394-2
DOI :
10.1109/CVPR.2011.5995570