Virtual focusing image synthesis for user-specified image region using camera array

Synthetic aperture focusing can produce a virtual image where objects lying on a specified focal plane are focused while object lying off the plane are blurred, by averaging the multiview images warped by planar homographies. In this paper, we propose a method for efficiently estimating a focal plane from multiview stereo images so that a user-specified image region is focused in the virtual image. We estimate the 3D parameters of a focal plane, which corresponds to a planar surface in the image region, by using a fast multiview direct method with image pair selection. We select the dasiabestdasia image pair by evaluating both pre-computed condition numbers of Hessian matrices and stereo baseline lengths. Our method can rapidly produce a unique virtual image, referred to as a virtual focal plane (VFP) image, where the image region lying on a non-frontparallel plane in the scene is focused.