A framework for the detection and interaction with pedestrian and objects in an unknown environment

In this paper, we present a visual scene description and interaction framework for pedestrian and mobile objects detection and tracking applications. The framework is built upon a previously developed stereo vision system. The proposed algorithms raise up the information level in order to allow to query about the scene using natural language or semantic operators and give a simpler interface with other technologies.