• DocumentCode
    1465833
  • Title

    Coded Strobing Photography: Compressive Sensing of High Speed Periodic Videos

  • Author

    Veeraraghavan, Ashok ; Reddy, Dikpal ; Raskar, Ramesh

  • Author_Institution
    Mitsubishi Electr. Res. Labs., Cambridge, MA, USA
  • Volume
    33
  • Issue
    4
  • fYear
    2011
  • fDate
    4/1/2011 12:00:00 AM
  • Firstpage
    671
  • Lastpage
    686
  • Abstract
    We show that, via temporal modulation, one can observe and capture a high-speed periodic video well beyond the abilities of a low-frame-rate camera. By strobing the exposure with unique sequences within the integration time of each frame, we take coded projections of dynamic events. From a sequence of such frames, we reconstruct a high-speed video of the high-frequency periodic process. Strobing is used in entertainment, medical imaging, and industrial inspection to generate lower beat frequencies. But this is limited to scenes with a detectable single dominant frequency and requires high-intensity lighting. In this paper, we address the problem of sub-Nyquist sampling of periodic signals and show designs to capture and reconstruct such signals. The key result is that for such signals, the Nyquist rate constraint can be imposed on the strobe rate rather than the sensor rate. The technique is based on intentional aliasing of the frequency components of the periodic signal while the reconstruction algorithm exploits recent advances in sparse representations and compressive sensing. We exploit the sparsity of periodic signals in the Fourier domain to develop reconstruction algorithms that are inspired by compressive sensing.
  • Keywords
    Fourier transforms; image reconstruction; image sampling; image sequences; video signal processing; Fourier domain; Nyquist rate constraint; coded strobing photography; compressive sensing; dynamic event projection; high speed periodic videos; low-frame-rate camera; sub-Nyquist signal sampling; temporal modulation; video reconstruction; Biomedical imaging; Cameras; Frequency; Image reconstruction; Inspection; Layout; Photography; Reconstruction algorithms; Signal design; Signal sampling; Computational imaging; compressive sensing; compressive video sensing; high-speed imaging; stroboscopy.; Algorithms; Image Processing, Computer-Assisted; Photography; Signal Processing, Computer-Assisted; Video Recording;
  • fLanguage
    English
  • Journal_Title
    Pattern Analysis and Machine Intelligence, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0162-8828
  • Type

    jour

  • DOI
    10.1109/TPAMI.2010.87
  • Filename
    5444878