Real-time reflectance transformation using single frame surface orientation imager

In this paper, we propose real-time reflectance transformation system using correlation image sensor and four LEDs. Surface orientation of the object is encoded into amplitude and phase of the reflected light intensity by using phase shifted blinking LEDs, The correlation image sensor, provided by us, demodulates those amplitude and phase in each pixel during exposure time. Therefore, the surface orientation is captured by single frame, which can be applied moving object. We developed reflectance transformation system using surface orientation captured by our real-time surface orientation imager. We demonstrated that the system provides relighting and changing reflectance property in real-time.