Electroencephalogram (EEG) signal virtual-keyboard design method based on multiple modes

Abstract

The invention discloses an electroencephalogram (EEG) signal virtual-keyboard design method based on multiple modes. An event-related potential (ERP) of the method is a special brain-evoked potential,and reflects nerve-electrophysiology changes of a brain in a cognitive process. SSVEP is periodic response of the brain to external visual stimuli modulated at certain frequency (greater than 6Hz), and EEG of a brain visual-cortex under the paradigm shows distinct peak value features at the stimulation frequency and harmonics thereof. Early components of N1 and P2 of ERP of all brain regions aresignificantly different from amplitudes in an incubation period, and also have differences in scalp distribution. SSVEP can extract frequency spectrum features of 12Hz, 15Hz, 18Hz and 20Hz through a canonical correlation analysis (CCA) method, thus the early components of N1 and P2 of ERP can be used as row coordinates of a virtual keyboard, and the frequency spectrum features corresponding to SSVEP can be used as column coordinates of the virtual keyboard, and accuracy of the virtual keyboard based on EEG signals is greatly increased.

Description

technical field [0001] The invention belongs to the combination of cognitive neuroscience and information technology, specifically relates to the technical field of digital signal processing, in particular to a method for designing a virtual keyboard based on multi-mode EEG signals. Background technique [0002] Brain-Computer Interface (BCI) is a brain-computer communication system that does not depend on the normal output pathways composed of peripheral nerves and muscles in the brain. It is a new type of human-computer interaction system. Establish a connection between them, and use the EEG signals collected from the human brain to control computers or other external electronic devices to achieve human-computer interaction. The research on the design of virtual keyboard based on brain-computer interface makes the human-computer interaction between the brain and the outside world possible, and has a wide range of potential applications in the fields of medicine, intelligen...

AI Technical Summary

Problems solved by technology

The mouse and keyboard are necessary control accessories for computers. Nowadays, many brain-computer interface systems that implement speller and cursor control have a single function. Now they can realize speller or cursor tasks, and they cannot be well integrated with ordinary computers. It is necessary to develop corresponding Only special applications can be used by users, which increases the research and development cost of the brain-computer interface system and limits the promotion of brain-computer interface applications

Moreover, most of the existing brain-computer interface systems are only based on the single-mode EEG feature system, and the functions that can be realized by the system are limited, which limits the application of the brain-computer interface system.

The multi-mode brain-computer interface technology can greatly improve the performance of the existing brain-computer interface system and provide more abundant control signals, but it also brings new challenges to the research of BCI, such as the multi-mode brain-computer interface technology. Stimulus paradigm design of interface system, feature extraction, recognition and classification of multi-mode EEG signals, etc.

Images