Eye blink detection based on multiple Gabor response waves

Eye blink detection is useful in many applications, such as human-computer interface, driver awareness detection, and so on. Here we consider eye blink as an evidence of liveness to exclude using some fakes, mainly 2D photographs, to spoof face recognition systems. The detection of eye blink is done by signal analysis of multi-scale and multi-orientation Gabor responses of eye images. First, based on Gabor decomposition, we derive multiple Gabor response waves (GRW) and show some of them are homo-responsive to the behavior of eye blink. Second, probable blinking signals contained in GRWs are segmented out and reshaped into pulses. Third, the ratio of the union to the intersection (RUI) of the reshaped pulses is proposed as the indicator of the extent of eye blink. Our method has successfully detected eye blink under various conditions and can be applied to liveness detection in video-based face recognition system.