Multimodal human-machine interface based on a brain-computer interface and an electrooculography interface

This paper describes a multimodal interface that combines a Brain-Computer Interface (BCI) with an electrooculography (EOG) interface. The non-invasive spontaneous BCI registers the electrical brain activity through surface electrodes. The EOG interface detects the eye movements through electrodes placed on the face around the eyes. Both kind of signals are registered together and processed to obtain the mental task that the user is thinking and the eye movement performed by the user. Both commands (mental task and eye movement) are combined in order to move a dot in a graphic user interface (GUI). Several experimental tests have been made where the users perform a trajectory to get closer to some targets. To perform the trajectory the user moves the dot in a plane with the EOG interface and using the BCI the dot changes its height.