The application provides a Chinese
spoken language intention recognition brain-computer interface
system based on a sound-meaning integration double model, belongs to the technical field of
biomedical engineering, and relates to language brain-computer interface technology. Taking sound-meaning integration as the core, the stereotactic intracranial electroencephalogram (sEEG) technology is adopted to collect neural signals of the brain articulatory motor coding area and the semantic concept organization coding area. The
system comprises a voice
initiation decoder, a speech decoder, a semantic decoder and a
Chinese word speech-semantic fusion synthesizer, the target decoder is constructed by extracting high gamma band features of key brain areas of the
frontal lobe (left inferior frontal gyrus, premotor cortex, etc.), the
temporal lobe (anterior
temporal lobe, dorsolateral
temporal lobe, etc.). At the same time, a visual and auditory induction training paradigm is matched, three tasks of listening to sound to group words, looking at words to group words and word association are set, and the subjects are supported to generate words independently. The
system effectively solves the homonym and near homonym word
ambiguity problem in Chinese
spoken language recognition, and provides a precise interactive tool for ALS and other
speech disorder patients.