The invention provides a Chinese
spoken language intention recognition brain-computer interface
system based on pronunciation-meaning integration double models, belongs to the technical field of
biomedical engineering, and relates to a language brain-computer interface technology. Sound-sense integration is taken as a core, and a stereotactic intracranial electroencephalogram (sEEG) technology is adopted to acquire neural signals of a brain phonetic motion
coding region and a semantic concept organization
coding region. The
system comprises a
sound production starting decoder, a voice decoder, a semantic decoder and a
Chinese word voice-semantic fusion synthesizer, and a target decoder is constructed by extracting high gamma
wave band characteristics of key brain regions of
frontal lobe (left subfrontal gyrus, anterior cortex of motion and the like) and
temporal lobe (anterior
temporal lobe, dorsal lateral
temporal lobe and the like). Meanwhile, an audio-visual induction training normal form is matched, three tasks of listening word combination, character reading word combination and vocabulary association are set, and subjects are supported to autonomously generate vocabularies. The
system effectively solves the problem of
ambiguity of homophonous and near-phonetic words in spoken Chinese recognition, and provides an accurate interaction tool for
speech disorder patients such as ALS and the like.