Title :
Interactive detection of incrementally learned concepts in images with ranking and semantic query interpretation
Author :
Schutte, Klamer ; Bouma, Henri ; Schavemaker, John ; Daniele, Laura ; Sappelli, Maya ; Koot, Gijs ; Eendebak, Pieter ; Azzopardi, George ; Spitters, Martijn ; de Boer, Maaike ; Kruithof, Maarten ; Brandt, Paul
Author_Institution :
TNO, The Hague, Netherlands
Abstract :
The number of networked cameras is growing exponentially. Multiple applications in different domains result in an increasing need to search semantically over video sensor data. In this paper, we present the GOOSE demonstrator, which is a real-time general-purpose search engine that allows users to pose natural language queries to retrieve corresponding images. Top-down, this demonstrator interprets queries, which are presented as an intuitive graph to collect user feedback. Bottom-up, the system automatically recognizes and localizes concepts in images and it can incrementally learn novel concepts. A smart ranking combines both and allows effective retrieval of relevant images.
Keywords :
directed graphs; feature extraction; image retrieval; learning (artificial intelligence); natural language processing; relevance feedback; search engines; GOOSE demonstrator; image retrieval; incremental learning; interactive detection; intuitive graph; natural language query; search engine; semantic query interpretation; smart reranking; user feedback; Animals; Cameras; Databases; Natural languages; Semantics; Streaming media; Training; Semantic reasoning; concept detection; incremental learning;
Conference_Titel :
Content-Based Multimedia Indexing (CBMI), 2015 13th International Workshop on
DOI :
10.1109/CBMI.2015.7153623
