Web-Based Multi-Observer Segmentation Evaluation Tool

Multi-observer segmentation evaluation is useful in the imaging community. We have developed web-based software for automatic performance evaluation of multiple image segmentations which is based on the Baysian decision framework. It computes a probabilistic estimate of the true segmentation (ground truth map) and performance measures for the individual segmentations (sensitivity and specificity). The strength of the tool is that it integrates the two kinds of prior knowledge of segmentations: the truth prior (the prior probability) and the observer prior (the performance measures of observers), which can generate more accurate evaluations.