Audiovisual dual-mode semantic matching and semantic mismatch co-stimulus brain-computer interface paradigm

Abstract

The invention relates to the brain-computer interface (BCI) paradigms and lays the foundation for providing a novel BCI audiovisual dual-mode stimulus paradigm and researching the responding mechanism of the brain to audiovisual synergic relationship under brain-computer interface paradigm so as to help understand the responding mechanism of the brain to audiovisual stimulus in deeper depth and perfect the audiovisual dual-mode brain-computer interface system in the hope for obtaining considerable social benefit and economic benefit. The technical scheme of the invention is that the audiovisual dual-mode semantic matching and semantic mismatch co-stimulus brain-computer interface paradigm collects behavioral data and electroencephalogram under different stimulus paradigms; brain control commands are output through analyzing the behavioral data, abstracting and analyzing the electroencephalogram features and classifying target stimulus and non-target stimulus under different paradigms. The invention is mainly applied in brain-computer interface situations.

Description

technical field [0001] The present invention relates to a brain-computer interface (BCI) paradigm, in particular, to a brain-computer interface based on an audio-visual bimodal semantic matching and semantic mismatch synergy paradigm. Background technique [0002] Brain-computer interface (BCI) is a new type of interaction, which can realize the interaction between human and computer or other machine equipment without using limbs or peripheral neuromuscular, and finally turns "thought" into "action". In the current research and application of BCI systems, it is generally believed that the BCI system based on event-related potential (ERP) (ERP-BCI) is more efficient and stable. In the ERP-BCI system, users can select target characters or tasks through selective attention to visual, auditory and other stimuli. [0003] At present, the ERP-BCI system for audio-visual information is mostly researched on a single mode, and its research programs are limited, and it is difficult t...

AI Technical Summary

Problems solved by technology

[0003] At present, most of the ERP-BCI systems for audiovisual information are researched on a single mode, and the research programs are limited, and the system efficiency is difficult to improve.

The problem existing in the study of audio-visual multi-modal information is that the BCI system based on audio-visual information cannot reflect the superiority of audio-visual dual-modal information, and the conclusions obtained by the current research are inconsistent, and there is a lack of reasonable brain response mechanism under the application of brain-computer interface

However, practical BCI research indicates no significant difference between visually related bimodal stimuli compared to visual stimuli alone

At present, the difference between the event-related potential (Event-Related Potential, ERP) evoked by visually related bimodal stimuli and single visual stimuli in BCI is not obvious. , the BCI system of audio-visual dual-modal stimulation did not show superiority

Images