Title :
Multichannel EEG sonification with ambisonics spatial sound environment
Author :
Rutkowski, Tomasz M.
Author_Institution :
TARA Life Sci. Center, Univ. of Tsukuba, Tsukuba, Japan
Abstract :
When performing complex analyzes on multivariate processes, it is often convenient to utilize various types of visualizations in order to untangle and interpret spatiotemporal dependencies between mixed information streams, and to perform input variable selection. This is particularly advantageous when a level of noise is high, the target of interest information stream changes its spatial location with time, and also for spatiotemporal processes where several streams contain meaningful information, such as in the case of multichannel recordings of electroencephalogram (EEG) based brain activity monitoring which is of a core interest in neurosciences. To provide insight into the dynamics of brainwave steady-state electrical responses, a sonification of EEG is proposed, whereby the information about the spatiotemporal steady-state response dynamics is modeled using a spatial sound reproducing ambisonics approach. Owing to its data-driven and fully adaptive mode of operation, synchro-squeezing transform (SST) is employed as a time-frequency decomposer, and the brain responses to steady-state visual evoked responses (SSVEP) stimuli are sonified. Such perceptual feedback has enormous potential in multichannel brainwave recording analyzes.
Keywords :
brain; electroencephalography; medical signal processing; neurophysiology; patient monitoring; spatiotemporal phenomena; visual evoked potentials; wavelet transforms; EEG-based brain activity monitoring; SST; SSVEP stimuli; electroencephalogram-based brain activity monitoring; interpret spatiotemporal process; multichannel EEG recordings; multichannel EEG sonification; multichannel brainwave recording analyzes; neurosciences; perceptual feedback; spatial sound reproducing ambisonics approach; spatiotemporal steady-state response dynamics; state electrical response dynamics; steady-state visual evoked responses; synchro-squeezing transform; time-frequency decomposer; untangle spatiotemporal process; Brain modeling; Electroencephalography; Loudspeakers; Visualization; Wavelet transforms;
Conference_Titel :
Asia-Pacific Signal and Information Processing Association, 2014 Annual Summit and Conference (APSIPA)
Conference_Location :
Siem Reap
DOI :
10.1109/APSIPA.2014.7041817