Real-time 3D reconstruction on high resolution focal plane array

We propose an original real-time image processing architecture to be implemented on a smart focal plane array. The main point of our approach is the using of a single focal plane array to process two stereo video streams projected by an adapted optical system on the circuit surface. The system provides in real-time (faster than 100 image pairs per second) 3D-scene reconstruction. Some other extra information like object extraction or 3D-map confidence is provided in the same time. Our architecture uses a hexagonal network of fast and small pixel cells, to provide local process functions like horizontal image shifting, 2D correlation computing and Gaussian or nonlinear filtering