Evaluation of coded structured light methods using ground truth

Until now, the lack of the ground truth has prevented such direct comparisons of coded structured light algorithms. In this paper, an evaluation framework is proposed to compare different kinds of methods. First the ground truth is obtained by the robust space-time analysis. Then our evaluation methodology is introduced to describe the algorithm´s performance. Two indices, the accuracy and recall are defined for each method. Finally, quantitative and qualitative comparisons are conducted in our experiments. Four well known coding methods are evaluated using three benchmark datasets. The results show the multi-shot shape acquisition methods have better performances than one-shot shape acquisition methods. When different decoding algorithms are adopted for the same coding method, the accuracies and recalls are changed. This evaluation framework can help to make the quantitative comparison of algorithms and prompt the further advance in algorithm performance.