Audiovisual dual-mode semantic matching and semantic mismatch co-stimulus brain-computer interface paradigm

A technology of semantic matching and co-stimulation, applied in the direction of mechanical mode conversion, computer components, user/computer interaction input/output, etc., can solve problems such as limited research plans, inconsistent conclusions, and inconspicuous differences, and achieve fast response speed , improve efficiency, and respond to large effects

Active Publication Date: 2017-04-19
TIANJIN UNIV
View PDF6 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, most of the ERP-BCI systems for audiovisual information are researched on a single mode, and the research programs are limited, and the system efficiency is difficult to improve.
The problem existing in the study of audio-visual multi-modal information is that the BCI system based on audio-visual information cannot reflect the superiority of audio-visual dual-modal information, and the conclusions obtained by the current research are inconsistent, and there is a lack of

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Audiovisual dual-mode semantic matching and semantic mismatch co-stimulus brain-computer interface paradigm
  • Audiovisual dual-mode semantic matching and semantic mismatch co-stimulus brain-computer interface paradigm
  • Audiovisual dual-mode semantic matching and semantic mismatch co-stimulus brain-computer interface paradigm

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0038] The present invention proposes a brain-computer interface (BCI) paradigm based on the audiovisual bimodal semantic matching and mismatch coordination mechanism. The synergy relationship refers to the relationship between bimodal information when the visual and auditory information represent the same meaning and the brain responds to the visual and auditory fusion information. The brain response mechanism at this time is referred to as the "cooperative mechanism". The present invention converts the traditional single-modal stimulation method into a dual-modal stimulation method with simultaneous visual and auditory stimulation, thereby inducing the corresponding audiovisual bimodal event-related potential signal (VAERP), and extracts and integrates the characteristics of VAERP. Classification can realize the output of brain control commands. This design is helpful to study the synergy mechanism of audiovisual bimodality under different stimulus paradigms.

[0039] On the b...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the brain-computer interface (BCI) paradigms and lays the foundation for providing a novel BCI audiovisual dual-mode stimulus paradigm and researching the responding mechanism of the brain to audiovisual synergic relationship under brain-computer interface paradigm so as to help understand the responding mechanism of the brain to audiovisual stimulus in deeper depth and perfect the audiovisual dual-mode brain-computer interface system in the hope for obtaining considerable social benefit and economic benefit. The technical scheme of the invention is that the audiovisual dual-mode semantic matching and semantic mismatch co-stimulus brain-computer interface paradigm collects behavioral data and electroencephalogram under different stimulus paradigms; brain control commands are output through analyzing the behavioral data, abstracting and analyzing the electroencephalogram features and classifying target stimulus and non-target stimulus under different paradigms. The invention is mainly applied in brain-computer interface situations.

Description

technical field [0001] The present invention relates to a brain-computer interface (BCI) paradigm, in particular, to a brain-computer interface based on an audio-visual bimodal semantic matching and semantic mismatch synergy paradigm. Background technique [0002] Brain-computer interface (BCI) is a new type of interaction, which can realize the interaction between human and computer or other machine equipment without using limbs or peripheral neuromuscular, and finally turns "thought" into "action". In the current research and application of BCI systems, it is generally believed that the BCI system based on event-related potential (ERP) (ERP-BCI) is more efficient and stable. In the ERP-BCI system, users can select target characters or tasks through selective attention to visual, auditory and other stimuli. [0003] At present, the ERP-BCI system for audio-visual information is mostly researched on a single mode, and its research programs are limited, and it is difficult t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01
Inventor 安兴伟明东魏晋文刘爽许敏鹏綦宏志何峰周鹏杨佳佳
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap