Real-time objects tracking by using smart image sensor and FPGA

We have been investigating the integration of sensing and compression on an image sensor. The compression sensor reduces the number of pixels in the image signal that have to be readout from the sensor. We present a real-time object tracking system using a compression sensor, which has 128×128 pixels, and FPGA. By using this system, several moving objects can be extracted and tracked independently at 1200 frames/second. We also describe real-time depth estimation by using binocular compression sensors. We show some results obtained by the system.