Title :
Hardware accelerated visual attention algorithm
Author :
Akselrod, Polina ; Zhao, Faye ; Derekli, Ifigeneia ; Farabet, Clément ; Martini, Berin ; LeCun, Yann ; Culurciello, Eugenio
Author_Institution :
Electr. Eng. Dept., Yale Univ., New Haven, CT, USA
Abstract :
We present a hardware-accelerated implementation of a bottom-up visual attention algorithm. This algorithm generates a multi-scale saliency map from differences in image intensity, color, presence of edges and presence of motion. The visual attention algorithm is computed on a custom-designed FPGA-based dataflow computer for general-purpose state-of-the-art vision algorithms. The vision algorithm is accelerated by our hardware platform and reports ×4 speedup when compared to a standard laptop with a 2.26 GHz Intel Dual Core processor and for image sizes of 480 × 480 pixels. We developed a real time demo application running at >; 12 frames per second with the same size images. We also compared the results of the hardware implementation of the algorithm to the eye fixation points of different subjects on six video sequences. We find that our implementation achieves precisions of fixation predictions of up to 1/14th of the size of the video frames.
Keywords :
computer vision; field programmable gate arrays; image colour analysis; image motion analysis; image sequences; microprocessor chips; Intel dual core processor; a bottom-up visual attention algorithm; custom-designed FPGA-based data flow computer; frequency 2.26 GHz; general-purpose vision algorithms; hardware accelerated visual attention algorithm; image intensity; multiscale saliency map; video frames; video sequences; USA Councils; FPGA; botttom-up; embedded hardware; hardware acceleration; saliency; vision systems; visual attention;
Conference_Titel :
Information Sciences and Systems (CISS), 2011 45th Annual Conference on
Conference_Location :
Baltimore, MD
Print_ISBN :
978-1-4244-9846-8
Electronic_ISBN :
978-1-4244-9847-5
DOI :
10.1109/CISS.2011.5766191