Title :
Coded Strobing Photography: Compressive Sensing of High Speed Periodic Videos
Author :
Veeraraghavan, Ashok ; Reddy, Dikpal ; Raskar, Ramesh
Author_Institution :
Mitsubishi Electr. Res. Labs., Cambridge, MA, USA
fDate :
4/1/2011 12:00:00 AM
Abstract :
We show that, via temporal modulation, one can observe and capture a high-speed periodic video well beyond the abilities of a low-frame-rate camera. By strobing the exposure with unique sequences within the integration time of each frame, we take coded projections of dynamic events. From a sequence of such frames, we reconstruct a high-speed video of the high-frequency periodic process. Strobing is used in entertainment, medical imaging, and industrial inspection to generate lower beat frequencies. But this is limited to scenes with a detectable single dominant frequency and requires high-intensity lighting. In this paper, we address the problem of sub-Nyquist sampling of periodic signals and show designs to capture and reconstruct such signals. The key result is that for such signals, the Nyquist rate constraint can be imposed on the strobe rate rather than the sensor rate. The technique is based on intentional aliasing of the frequency components of the periodic signal while the reconstruction algorithm exploits recent advances in sparse representations and compressive sensing. We exploit the sparsity of periodic signals in the Fourier domain to develop reconstruction algorithms that are inspired by compressive sensing.
Keywords :
Fourier transforms; image reconstruction; image sampling; image sequences; video signal processing; Fourier domain; Nyquist rate constraint; coded strobing photography; compressive sensing; dynamic event projection; high speed periodic videos; low-frame-rate camera; sub-Nyquist signal sampling; temporal modulation; video reconstruction; Biomedical imaging; Cameras; Frequency; Image reconstruction; Inspection; Layout; Photography; Reconstruction algorithms; Signal design; Signal sampling; Computational imaging; compressive sensing; compressive video sensing; high-speed imaging; stroboscopy.; Algorithms; Image Processing, Computer-Assisted; Photography; Signal Processing, Computer-Assisted; Video Recording;
Journal_Title :
Pattern Analysis and Machine Intelligence, IEEE Transactions on
DOI :
10.1109/TPAMI.2010.87