A multimodal approach to analysis of steady state visually evoked potentials

Steady state visually evoked potentials (SSVEPs), recorded from the central nervous system of humans using electroencephalography (EEG) in response to visual stimuli, have recently gained attention in cognitive and clinical neuroscience [1]. Here, we fuse EEG SSVEPs with recordings from functional magnetic resonance imaging data (fMRI) utilizing the millisecond temporal resolution of the former and the excellent spatial resolution of the latter. In particular, we propose a spatio-frequency EEG/fMRI fusion framework to recover the frequency content from the EEG and spatial information from the fMRI to enhance our understanding of SSVEPs. Notably, we consider fused analysis of fMRI and EEG data collected independently. We demonstrate that the proposed approach is a practical data-driven method to achieve spatio-frequency fusion of EEG and fMRI SSVEP responses.