Computer-aided content-based cueing of remotely sensed images with the Image Content Engine (ICE)

Human analysts are often unable to meet time constraints on analysis and interpretation of large volumes of remotely sensed imagery. To address this problem, the Image Content Engine (ICE) system currently under development is organized into an off-line component for automated extraction of image features followed by user-interactive components for content detection and content-based query processing. The extracted features are vectors that represent attributes of three entities, namely image tiles, image regions and shapes, or suspected matches to models of objects. ICE allows users to interactively specify decision thresholds so that the content (consisting of entities whose features satisfy decision criteria) can be detected. ICE presents detected content to users as a prioritized series of thumbnail images. Users can either accept the detection results or specify a new set of decision thresholds. Once accepted, ICE stores the detected content in database tables and semantic graphs. Users can interactively query the tables and graphs for locations at which prescribed relationships between detected content exist. New queries can be submitted repeatedly until a satisfactory series of prioritized thumbnail image cues is produced. Examples are provided to demonstrate how ICE can be used to assist users in quickly finding prescribed collections of entities (both natural and man-made) in a set of large USGS aerial photos retrieved from TerraserverUSA