System and method for controlling brain computer interface (BCI) based on multimode fusion

A brain-computer interface and control system technology, applied in mechanical mode conversion, computer components, user/computer interaction input/output, etc., can solve problems such as difficulty in restarting, unsatisfactory information transmission rate, and inability to effectively control , to improve the information transmission rate and reliability, reduce the information transmission rate, and improve the effect of adapting to the crowd

Inactive Publication Date: 2013-01-09
TONGJI UNIV
View PDF2 Cites 63 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Difficulty restarting even though it can be turned off by the patient
[0008] 2) The environmental adaptability is poor, and the control itself requires a lot of user attention and environmental safety factors
Generally speaking, the biggest problem is poor reliability, and the information transmission rate is far from meetin...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method for controlling brain computer interface (BCI) based on multimode fusion
  • System and method for controlling brain computer interface (BCI) based on multimode fusion
  • System and method for controlling brain computer interface (BCI) based on multimode fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0057] This embodiment provides a brain-computer interface control system based on multi-modal fusion, such as figure 1 As shown, it includes: an EEG stimulation and feedback module, an EEG signal acquisition module, an EEG signal processing module, an execution module, an input control module, and a remote control module; the EEG signal processing module is respectively connected with the EEG signal acquisition module and the EEG signal processing module. The EEG stimulation is connected to the feedback module, the execution module is connected to the EEG signal processing module, the input control module is connected to the EEG signal processing module, and the remote control module is wirelessly connected to the EEG signal processing module.

[0058] Wherein, the EEG stimulation and feedback module is used for inducing SSVEP steady-state vision and inducing MI motor imagery; the EEG signal acquisition module is used for collecting EEG EEG signals; the EEG signal processing m...

Embodiment 2

[0074] This embodiment provides a brain-computer interface control method based on multi-modal fusion, such as Figure 4 As shown, the training step S0 and the control steps S1 to S4 are included, and the training step S0 is performed before the step S1;

[0075]The training step S0 includes:

[0076] S01, the auditory feedback unit in the EEG stimulation and feedback module sends out sound stimulation to induce the subject to perform MI motor imagery; at the same time, the SSVEP stimulation unit in the EEG stimulation and feedback module sends out visual stimulation to induce the subject's SSVEP steady-state vision ;

[0077] S02, the EEG signal acquisition module collects the EEG signal of the human brain;

[0078] S03, the EEG signal processing module extracts and identifies and classifies the SSVEP steady-state visual evoked potential feature and the MI motor imagery EEG feature in the EEG EEG signal;

[0079] S04, the EEG stimulation and feedback module judges whether ...

Embodiment 3

[0090] In this embodiment, the brain-computer interface control system and method based on multi-mode fusion is applied to a wheelchair (that is, the execution module is a wheelchair), and an artificial intelligence wheelchair is realized. The development environment of the artificial intelligence wheelchair can use a PC The software environment of matlab2009 and above under the Windows operating system of the computer requires the support of serial communication hardware equipment. The artificial intelligence wheelchair is mainly composed of user training and real-time wheelchair control. Users need to undergo virtual reality interactive training for visual and auditory collaborative perception. After the classification accuracy of the EEG model is guaranteed and the relevant parameter settings are confirmed, the actual control operation of the wheelchair can be performed.

[0091] 【User training test】

[0092] 1. MI motor imagery training: The classification and recognition...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a system and method for controlling a brain computer interface (BCI) based on multimode fusion. The system comprises a brain electrostimulation and feedback module, an electroencephalogram (EEG) signal acquisition module, an EEG signal processing module and an execution module, wherein the brain electrostimulation and feedback module is used for evoking an SSVEP (Steady State Visual Evoked Potential) and inducing an MI (Motor Imagery); the EEG signal acquisition module is used for acquiring EEG signals; the EEG signal processing module is used for extracting, identifying and classifying SSVEP characteristics and MI EEG characteristics in the EEG signals and feeding classified results which respectively correspond to the SSVEP characteristics and the MI EEG characteristics back to the brain electrostimulation and feedback module; and the execution module is used for executing the classified results. According to the system and the method, a multimode fusion BCI is constructed, so that the information transmission rate, reliability and flexibility of a control system are improved, the low information transmission rate of a BCI in a single MI mode is reduced, meanwhile, the visual burden under a single SSVEP task is reduced, and the adaptation crowds of the BIC-based control system are increased.

Description

technical field [0001] The invention belongs to the field of artificial intelligence, and relates to a brain-computer interface control system and method based on multi-mode fusion. Background technique [0002] Brain Computer Interface (BCI) is a new way of human-computer interaction. It uses advanced machine learning and pattern recognition algorithms to identify the neural activity signals of the brain under different thinking activities, and translate them into control commands for direct control. external devices, thereby establishing direct communication between the human brain and external devices. The research of brain-computer interface is becoming a hot spot in artificial intelligence and rehabilitation engineering, and has received more and more extensive attention. [0003] Existing BCI systems are all based on a single pattern of EEG signals, which can be classified into three categories: the first category is the BCI system based on event-related desynchroniza...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01
Inventor 蒋昌俊李洁孙杳如季洪飞何良华曹磊徐卓沈剑铭王大明
Owner TONGJI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap