Segment-Based Multi-View Depth Map Estimation Using Belief Propagation from Dense Multi-View Video

In this paper, we propose a new depth map estimation algorithm based on image segments. We assume that the three-dimensional scene is composed of several non- overlapping planes in a depth space. After homogeneous color segments are determined by the image segmentation, we assign one depth value to one segment using 3D warping and segment-based matching technique. In the refinement process, we apply a segment-based belief propagation method to refine the initial depth map. Experimental results demonstrate that the refined depth map maintains object boundaries and contains proper depth values.