Unlock instant, AI-driven research and patent intelligence for your innovation.

Deep learning man-machine interaction motor imagery brain-computer interface system and training method

A technology of motor imagery and brain-computer interface, applied in the fields of application, medical science, psychotherapy, etc., can solve problems such as poor stability of EEG signals, no literature and reports found, and low dimensionality of classification results, and achieve a wide range of applications and expansion Effects that apply space and improve accuracy

Active Publication Date: 2019-12-03
XIDIAN UNIV
View PDF4 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, EEG is a kind of high-dimensional information, which contains rich and detailed information about SMR intensity, position distribution and stability; the classification results of motor imagery in existing human-computer interaction methods have low dimensions, and the EEG between different users The difference between signal acquisition and classification effects is large, and the stability of EEG signals is poor. The classification effect cannot present the above-mentioned rich information to users during changes, and thus cannot achieve more informative feedback.
[0007] The present invention has not yet found literature and reports related to the subject of the present invention through searching and novelty search within a certain range

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deep learning man-machine interaction motor imagery brain-computer interface system and training method
  • Deep learning man-machine interaction motor imagery brain-computer interface system and training method
  • Deep learning man-machine interaction motor imagery brain-computer interface system and training method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] Brain-computer interface technology has a very promising application space in many fields such as military affairs, medical rehabilitation, education and entertainment. MI-BCI has been the first to be explored and laid out by various military powers in terms of coordinated command of military operations and control of military weapons; there is also great room for exploration in application scenarios such as medical rehabilitation training and exoskeleton control; at the same time, in education training and toy games Residential consumer markets, such as residential areas, are being tapped by many large companies and start-ups.

[0039] In the above application fields and scenarios, the accuracy and stability of MI-BCI need to be improved. Traditional research on MI-BCI decoding algorithms and paradigms cannot fundamentally solve the problem of incorrect and inaccurate imagination of users, nor can it complete the personalized adaptation of users and algorithms.

[004...

Embodiment 2

[0051] The overall composition and specific design of the human-computer adaptive motor imagery brain-computer interface system (DeCa-BCI) based on deep learning are the same as those in Embodiment 1. The construction of the STD-Net module in the present invention is as follows:

[0052] see figure 1 , the STD-Net module is divided into the ST-Net sub-module and the discrimination network layer sub-module, the ST-Net sub-module contains the ST-Net network, and the discrimination network layer sub-module contains the discrimination network layer; the ST-Net sub-module realizes the brain The electrical EEG signal is transformed from the two-dimensional matrix data of time T* lead C into a signal conversion image related to the type of motor imagery task that the user can intuitively identify, and the signal conversion image is grayscale with strong discriminative information Image and shape can be set by yourself, for example, the grayscale image is in the shape of left or right...

Embodiment 3

[0059] The overall composition and specific design of the human-computer adaptive motor imagery brain-computer interface system (DeCa-BCI) based on deep learning are the same as those in Example 1-2. The data set module is constructed as follows:

[0060] The data set of the present invention includes the original EEG data and the matching signal conversion target image and category label; the data format of the original EEG data is the same as the output of the system's EEG data acquisition module; the category label is the category of motor imagination ; see Figure 4 , the signal conversion target image is a grayscale image that contains strong discriminative information consistent with the class label. For example, define the signal conversion target image of the left and right hand motor imagery task as a grayscale image of the left or right cross star, with an aspect ratio of 2:1, a png format image with a black background and a white cross on one side.

[0061] The dat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a human-computer interaction motor imagery brain-computer interface system based on deep learning and a training method, and solves the problems of large effect difference andpoor electroencephalogram signal stability among different users. The system is connected with an electroencephalogram data acquisition module, a data preprocessing module, a signal conversion discrimination network and a visual feedback presentation module, and further comprises a data set module composed of original electroencephalogram data, a signal conversion target image and a category label. The training method comprises three stages of general pre-training, mutual adaptive feedback calibration and online use. Mutual adaptation training comprises multiple rounds of man-machine mutual adaptation training, and each round of training comprises free training, task imagination data collection and machine training. In the training process, real-time feedback of 'human-in-the-loop' is adopted, so that a user learns a correct and stable decodable motor imagery mode in trial and error, the performance of a motor imagery brain-computer interface is improved, and high-precision stable classification of motor imagery of the user is realized. The system and method are mainly used for meeting efficient brain-computer interaction requirements.

Description

technical field [0001] The present invention belongs to the field of information technology, and further relates to the realization of personalized extraction of motor imagery EEG information in users by DNN through collaborative adaptive feedback training between users and Deep Neural Network (DNN) in biological crossover technology, specifically It is a human-computer adaptive motor imagery brain-computer interface system and training method based on deep learning, which is used to improve the performance of the motor imagery brain-computer interface and realize high-precision and stable classification of the user's motor imagery. Background technique [0002] A brain-computer interface is a direct connection pathway established between the brain and external devices. Brain-computer interface (BCI) technology is the product of the cross-integration of biotechnology and computer technology. It is an important means for human beings to explore and develop the brain, and it i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G16H20/70G06K9/62A61B5/0476
CPCG16H20/70A61B5/369G06F18/241
Inventor 李甫付博勋钱若浩吴昊冀有硕石光明牛毅董伟生
Owner XIDIAN UNIV