Efficient free viewpoint image reconstruction from multi-focus imaging sequences based on dimension reduction

This paper deals with the technique for generating free viewpoint images by using multi-focus imaging sequences. The method may enable us to realize dense 4-D ray-space reconstruction from 3-D multi-focus imaging sequences. Previously, we proposed a method of generating free viewpoint, iris and focus images directly from multi-focus imaging sequences with a 3-D convolution filter that expresses how the scene is defocused in the sequence. However, the cost of the spatial frequency analysis based on 3-D FFT is not inexpensive. In this paper, efficient reconstruction of free viewpoint images by dimension reduction and 2-D FFT is discussed. We show some experimental results by using synthetic images. Epipolar plane images are also reconstructed in order to estimate the disparity between generated free viewpoint images.