Semantically indexed and searched of digital images using lexical ontologies and named entity recognition

Using low-level features to support semantic search of images is a difficult task. As a result, textual content is used to provide semantic description or annotation of images. Such textual description of what we may call as `surrounding text´ is a value added features available in most web images particularly on-line newspaper images. Most search engines used them as a feature to provide textual meaning of images. Relying on surrounding text alone, however, unable to provide support for semantic search that go beyond indexed terms. Lexical resources and ontology are potential sources to enhance searching for images. This paper discusses the use of WordNet and ConceptNet to enhance searching for on-line newspaper images. This is further improved with named entity recognition (NER) technique to annotate important entities such as name if a person, location and organization among image searchers. Results show that our semantic search approaches outperform the normal approach for searching images.