Visibility-driven patch group generation

The target application of this paper is 3D scene reconstruction for future real-time production scenarios in the broadcast domain as well as future post-production and on-set visual effect previews in the digital cinema area. Our approach is based on multiple trifocal camera capture systems which can be arbitrarily distributed on set. In this work we tackle the problem of multi-view data fusion from a real-time perspective. The novelty of our work is that instead of performing a pixel wise processing we consider patch groups as higher level scene representations. Based on the robust results of the trifocal sub-systems we implicitly obtain an optimized set of patch groups even for partly occluded regions by the application of a simple geometric rule set. Further on, we show that a simplified meshing can be applied to the patch group borders which enables a GPU centric real-time implementation. The presented algorithm is tested on real world test shoot data for the case of 3D reconstruction of humans.