Implementing a real-time free-viewpoint video system on a PC-cluster

In this paper, we present a system generating free-viewpoint video in real-time using multiple cameras and a PC cluster. Our system firstly reconstructs a shape model of objects by the visual cone intersection method, secondly transforms the shape model represented in terms of a voxel form into a triangular patch form, thirdly colors vertexes of triangular patches, and finally displays the shape-color model from the virtual viewpoint directed by a user. In this paper, we describe implementation details of our system and show some experimental results.