Motion blur free photometric stereo using correlation image sensor

We developed a motion blur restoration technique for surface orientation images using a correlation image sensor. This system consists of two components; one is ring-shaped modulation illumination for encoding surface orientation into the amplitude and phase of the reflected light intensity, and the other is the three-phase correlation image sensor (3PCIS) for demodulating the amplitude and phase of reflected light. The object motion is formalized by optical flow constraints. It is solved by weighted integral methods (WIM) developed by us, which is a direct algebraic method. The weighted integral method is suitable for correlation image sensor, because exposure time corresponds to integral over time in WIM and reference signals used by 3PCIS correspond to weighted function in WIM. It is demonstrated by both simulation and experiments that modulation imaging with sinusoids can be used to remove motion blur not only in intensity images, but also in normal vector maps.