Automatic and threshold-free evaluation of 3D building roof reconstruction techniques

Although a large number of building roof reconstruction techniques from the remotely sensed data have been proposed, there is a serious lack in standard and automatic evaluation system. The manual evaluation systems are based on human judgment and so may be biased. Moreover, the application of such an evaluation system on a large data set requires a considerable amount of human involvement. In addition, the threshold-based evaluation systems that employ one or more thresholds while making correspondences between the detection and reference sets are also subjective since there is no unique way to choose the thresholds. This paper proposes an automatic and threshold-free evaluation system using the centre distances between the detected and reference entities. It neither requires any human involvement nor uses any thresholds. As a result, the proposed evaluation system can be exploited for a bias free evaluation of any roof reconstruction techniques, even on large data sets.