The invention discloses a brain-computer interface
system based on audio-
visual matching error monitoring, which is characterized in that: according to
EEG data obtained by three feedback paradigms of audio-
visual matching errors, important ERP components related to the audio-
visual matching errors are extracted by applying ERP analysis, so that neural responses in a
specific time window are interpreted; then, on the basis of time-
frequency analysis, dynamic changes of the electroencephalogram signals in different wave bands are captured, and the reliability and stability of the electroencephalogram activity in different feedback
modes are revealed by combining ITPC of the electroencephalogram activity; and finally, through an improved EEGNet model, automatic
feature extraction and efficient classification of the signals are realized, and the robustness and generalization ability of the
system are improved. The electroencephalogram signals have high nonlinearity and specificity, by combining ERP analysis, time-
frequency analysis and a
deep learning model, potential neural mechanisms of audio-visual matching errors can be more effectively understood, the performance of a brain-computer interface
system is improved, and the method is applied to
clinical research of
error processing related obstacles.