Tri-modal serial brain-computer interface method based on multi-information fusion

Abstract

The invention discloses a tri-modal serial brain-computer interface method based on multi-information fusion. The method includes the steps: stimulating a testee by the aid of two visual stimulus paradigms; extracting electroencephalogram data of the testee; setting relevant parameters, reading the electroencephalogram data, preprocessing the electroencephalogram data, extracting characteristics, recognizing modes and acquiring final mode recognition results; converting the final mode recognition results into control instructions, and fulfilling specific tasks by executing the control instructions. A mixed-paradigm brain-computer interface introduces electrophysiology control signals except for electroencephalogram signals, and application environments and objects of the brain-computer interface are expanded to some extent. The tri-modal serial brain-computer interface method has the advantages of high stability, more options, wide application range and the like, and a foundation is laid for the brain-computer interface to step into a wide-range time application stage as soon as possible. The method can be used for fields such as electronic entertainment and industrial control, a perfect brain-computer interface system can be obtained, and the method is expected to obtain considerable social benefits and economic benefits.

Description

technical field [0001] The invention relates to the field of man-machine interface, in particular to a three-mode serial brain-computer interface method based on multi-information fusion. Background technique [0002] The human-machine interface refers to the interface of the input / output device that establishes contact and exchanges information in the human-computer interaction interface. Human-computer interaction is a study of the interactive relationship between the system and the user. A system can be a variety of machines, or it can be computerized systems and software. The human-machine interface is a control circuit that realizes information transmission between a computer and a human-computer interaction device. It completes the conversion of information form and the function of information transmission control together with human-computer interaction equipment. The design of the human-computer interaction interface should include the user's understanding of the ...

AI Technical Summary

Problems solved by technology

[0004] Some operations and activities in real life are complex, and completing a specific task requires more steps and different operating procedures

Therefore, a single-paradigm BCI system is not enough to support users to complete a specific task and action in daily life

For example, to assist in grasping a water cup to drink water, two basic functions of moving and grasping need to be completed without considering the moving speed and grasping degree. This is something that a single paradigm BCI cannot output at the same time.

Existing brain-computer interface devices use a single type of EEG signal to manipulate the human-machine interface, resulting in a narrow range of applications, poor operational flexibility, and fewer operating instruction sets, which cannot reflect the user-friendliness and usability of the system

For example, the P300-Speller in the traditional stimulation coding mode is not conducive to the information transmission of a large instruction set, and there are problems such as low information transmission efficiency and limited number of optional characters, which are difficult to meet the requirements of practical applications

Images