Construction and compression of face models for multi-party videoconferencing with multi-camera

Multi-party videoconferencing systems have been recently used more and more, but they have still faced some challenges and problems. In this paper we present a novel method and framework to create face models and construct the gaze and face direction, which can make the user experience of multi-party videoconferencing more immersive and interactive. We utilize multi-camera and one display screen as the user terminal, so it can implement face modeling, gaze tracking and view synthesis. Applying our proposed method it can compress the transfer data and reduce the network bandwidth. Moreover it improves the effectiveness of video contents and lowers the requirements of system hardware.