Audiovisual dual-mode semantic matching and semantic mismatch co-stimulus brain-computer interface paradigm
A technology of semantic matching and co-stimulation, applied in the direction of mechanical mode conversion, computer components, user/computer interaction input/output, etc., can solve problems such as limited research plans, inconsistent conclusions, and inconspicuous differences, and achieve fast response speed , improve efficiency, and respond to large effects
Active Publication Date: 2017-04-19
TIANJIN UNIV
View PDF6 Cites 17 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0003] At present, most of the ERP-BCI systems for audiovisual information are researched on a single mode, and the research programs are limited, and the system efficiency is difficult to improve.
The problem existing in the study of audio-visual multi-modal information is that the BCI system based on audio-visual information cannot reflect the superiority of audio-visual dual-modal information, and the conclusions obtained by the current research are inconsistent, and there is a lack of reasonable brain response mechanism under the application of brain-computer interface
However, practical BCI research indicates no significant difference between visually related bimodal stimuli compared to visual stimuli alone
At present, the difference between the event-related potential (Event-Related Potential, ERP) evoked by visually related bimodal stimuli and single visual stimuli in BCI is not obvious. , the BCI system of audio-visual dual-modal stimulation did not show superiority
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0038]The invention proposes a brain-computer interface (BCI) paradigm based on an audio-visual bimodal semantic matching and mismatching coordination mechanism. The synergy relationship refers to the relationship between bimodal information when the visual and auditory information represent the same meaning and the brain responds to the fusion information of audiovisual and auditory information. The brain response mechanism at this time is referred to as "cooperative mechanism". The present invention transforms the traditional single-modal stimulation method into a dual-modal stimulation method with simultaneous visual and auditory stimulation, thereby eliciting a corresponding audio-visual dual-modal event-related potential signal (VAERP), through the extraction of VAERP features and Classification can realize the output of brain control commands. This design facilitates the study of synergistic mechanisms of audiovisual bimodality under different stimulus paradigms.
[003...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention relates to the brain-computer interface (BCI) paradigms and lays the foundation for providing a novel BCI audiovisual dual-mode stimulus paradigm and researching the responding mechanism of the brain to audiovisual synergic relationship under brain-computer interface paradigm so as to help understand the responding mechanism of the brain to audiovisual stimulus in deeper depth and perfect the audiovisual dual-mode brain-computer interface system in the hope for obtaining considerable social benefit and economic benefit. The technical scheme of the invention is that the audiovisual dual-mode semantic matching and semantic mismatch co-stimulus brain-computer interface paradigm collects behavioral data and electroencephalogram under different stimulus paradigms; brain control commands are output through analyzing the behavioral data, abstracting and analyzing the electroencephalogram features and classifying target stimulus and non-target stimulus under different paradigms. The invention is mainly applied in brain-computer interface situations.
Description
technical field [0001] The present invention relates to a brain-computer interface (BCI) paradigm, in particular, to a brain-computer interface based on an audio-visual bimodal semantic matching and semantic mismatch synergy paradigm. Background technique [0002] Brain-computer interface (BCI) is a new type of interaction, which can realize the interaction between human and computer or other machine equipment without using limbs or peripheral neuromuscular, and finally turns "thought" into "action". In the current research and application of BCI systems, it is generally believed that the BCI system based on event-related potential (ERP) (ERP-BCI) is more efficient and stable. In the ERP-BCI system, users can select target characters or tasks through selective attention to visual, auditory and other stimuli. [0003] At present, the ERP-BCI system for audio-visual information is mostly researched on a single mode, and its research programs are limited, and it is difficult t...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F3/01
Inventor 安兴伟明东魏晋文刘爽许敏鹏綦宏志何峰周鹏杨佳佳
Owner TIANJIN UNIV