Title :
Spoken sentences decoding based on intracranial high gamma response using dynamic time warping
Author :
Dan Zhang ; Enhao Gong ; Wei Wu ; Jiuluan Lin ; Wenjing Zhou ; Bo Hong
Author_Institution :
Dept. of Biomed. Eng., Tsinghua Univ., Beijing, China
fDate :
Aug. 28 2012-Sept. 1 2012
Abstract :
In this study, we explore the discriminability of high gamma activities from speech production cortex during the overt articulation of two sentences. Neural activities were recorded from one intracranial electrode placed approximately over the posterior part of the inferior frontal gyrus. By employing a dynamic time warping (DTW) method to realign single-trial high gamma response during speech productions, averaged temporal activation patterns corresponding to the two spoken sentences were obtained. Single-trial ECoG responses were subsequently classified according to their correlations with these two temporal activation patterns. On average, 77.5% of the trials were correctly classified, which was much higher than the chance-level performance of the SVM classifier without DTW. Our preliminary results shed light on the construction of cortical speech brain-computer interfaces on the sentence level.
Keywords :
biomedical electrodes; brain-computer interfaces; electroencephalography; medical signal processing; neurophysiology; signal classification; support vector machines; BCI; DTW method; SVM classifier; averaged temporal activation patterns; chance-level performance; cortical speech brain-computer interfaces; dynamic time warping method; high gamma activities; inferior frontal gyrus; intracranial electrode; intracranial high gamma response; neural activities; overt articulation; single-trial ECoG responses; single-trial high gamma response; speech production cortex; spoken sentences; spoken sentences decoding; temporal activation patterns; Correlation; Electrodes; Electroencephalography; Humans; Oscillators; Production; Speech; Adult; Brain-Computer Interfaces; Electroencephalography; Humans; Male; Speech;
Conference_Titel :
Engineering in Medicine and Biology Society (EMBC), 2012 Annual International Conference of the IEEE
Conference_Location :
San Diego, CA
Print_ISBN :
978-1-4244-4119-8
Electronic_ISBN :
1557-170X
DOI :
10.1109/EMBC.2012.6346668