Similarity matrices for a multi-media search engine

This paper describes how similarity matrices are being used to help indexing, browsing, and relevance feedback in a multi-media search engine. We describe the creation of a matrix of the pairwise similarities of image captions, which was used to provide a cartography of related image clusters. A matrix of semantic concept similarities was also produced as a basis for query formulation and relevance feedback.