DocumentCode :
3001815
Title :
Investigating the temporal dynamics of auditory cortical activation to silent lipreading
Author :
Crosse, Michael J. ; ElShafei, Hesham A. ; Foxe, John J. ; Lalor, Edmund C.
Author_Institution :
Sch. of Eng. & Trinity Centre for Bioeng., Trinity Coll. Dublin, Dublin, Ireland
fYear :
2015
fDate :
22-24 April 2015
Firstpage :
308
Lastpage :
311
Abstract :
Neuroimaging research has demonstrated that observing visual speech in the absence of auditory speech activates primary auditory cortex. However, it remains unclear what this activation precisely reflects. It is well established that, during continuous auditory speech, neural activity in auditory cortex tracks the temporal envelope of the speech signal. Recently, it has been suggested that this process may in fact reflect an internal synthesis of the speech stream rather than the encoding of the envelope per se. Could silent lipreading therefore elicit a similar “entrainment” to the envelope in the absence of auditory speech? Here, we test this hypothesis by examining the impact of lipreading accuracy on envelope tracking using electroencephalography (EEG). We provide evidence to suggest that the EEG response over left temporal scalp tracks the unheard speech more faithfully during accurate lipreading. We also demonstrate that the envelope can be reconstructed from EEG data recorded during silent lipreading with accuracy above chance level. This could have implications for brain-computer interface technology.
Keywords :
electroencephalography; hearing; medical signal processing; neurophysiology; speech synthesis; EEG; auditory cortical activation; brain-computer interface technology; continuous auditory speech; electroencephalography; neural activity; neuroimaging; primary auditory cortex; silent lipreading; speech signal temporal envelope tracking; temporal dynamics; temporal scalp; visual speech; Accuracy; Decoding; Electroencephalography; Image reconstruction; Scalp; Speech; Visualization;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Neural Engineering (NER), 2015 7th International IEEE/EMBS Conference on
Conference_Location :
Montpellier
Type :
conf
DOI :
10.1109/NER.2015.7146621
Filename :
7146621
Link To Document :
بازگشت