Adaptive streaming panoramic video for image based rendering system

In this paper, we present an adaptive panoramic video streaming scheme for distributed image based rendering (IBR) systems. Real-time rendering of complex 3D scene on mobile devices is a challenging task. The main reason is that mobile devices have limited computational capabilities and are lack of powerful 3D graphics hardware support. In such systems, server should take most of the computing job and than transmit the required image segments to client. So the efficient network transmission is vital for client to smoothly synthesize attractive 3D scenes. The proposed streaming scheme fulfils this task by probing the mobile network´s status and then effective adjust the sending data to avoid network congestion and jitter. Pre-fetching and cache management are also considered for efficient memory usage and reducing transmission requests. With the help of this scheme, we implemented an interactive distributed 3D walk through system on both mobile devices and desktop computers. Experimental results show that the adaptive panoramic video streaming scheme is useful for the distributed IBR systems.