Wearable brain-computer interface device, and human-computer interaction system and method

Abstract

The invention provides a wearable brain-computer interface device, and a human-machine interaction system and method, which can identify a user's intention accord to information of a user's surroundings. The portable brain-computer interface mainly includes: an EEG acquisition module, a display module, a sensor module, a processor module, and a communication module. The movable wearable human-computer interaction system integrating the brain-computer interface, near-eye display and machine vision can realize brain-control-based and limb-free peripheral equipment control in a moving environment. The method for identifying the user's intention includes: collecting and identifying user's surrounding environment information, and determining the user's intention according to the direction of the user's field of view. The problem that the existing brain-computer interfaces are difficult to carry and are inconvenient to apply can be solved; and the wearable brain-computer interface device hasexcellent convenience and portability, and high control accuracy and speed.

Description

technical field

[0001] The present invention relates to the field of human-computer interaction, in particular to a wearable brain-computer interface device, a human-computer interaction system and a method. Background technique

[0002] Brain-computer interface (BCI) is a new external information exchange and control technology that establishes a new external information exchange and control technology between the human brain and a computer or other electronic devices that does not rely on conventional brain information output pathways. Electroencephalography (EEG) is widely used in non-invasive BCI due to its advantages of high temporal resolution, easy acquisition, and low price. At present, the EEG signal components or types commonly used in BCI mainly include: event related synchronization / desynchronization (ERS / ERD), steady-state visual evoked potentials (SSVEP), Slow cortical potentials (slow cortical potentials, SCP), P300 and μ rhythm, β rhythm and so on.

[0003] ...

Examples

Embodiment 1

[0052] A portable brain-computer interface device, see figure 1 The hardware of the device includes: an EEG acquisition module, a display module, a sensor module, a processor module, a power supply module (not shown in the figure), a communication module and other modules, each of which is connected to the processor module and processed by controller module control. The whole device is integrated and worn on the user's head.

[0053] Among them, the EEG acquisition module includes: EEG electrodes and EEG amplifiers, etc., which are used for collecting (that is, collecting through EEG electrodes) and releasing EEG signals (that is, amplifying EEG signals through EEG amplifiers), The amplified EEG signal is digital-to-analog converted. The EEG acquisition module is controlled by the processor module and sends the collected EEG signals to the processor module.

[0054] Further, the display module includes: a micro-projector, a prism, etc., used for near-eye display of visual s...

Embodiment 2

[0061] The solution in Embodiment 1 is further introduced below in conjunction with specific devices, and details are described below:

[0062] 1. EEG acquisition module:

[0063] The EEG acquisition module includes: EEG electrodes and EEG amplifiers. EEG electrodes can be dry electrodes or wet electrodes, and the covered areas should include: visual cortex, forehead, top of the head, etc.

[0064] The available lead configurations are: POz, PO3, PO4, PO5, PO6, Oz, O1, O2, with the reference electrode placed on the top of the head and the ground electrode placed on the forehead.

[0065] During use, the impedance between each electrode and the reference electrode should be lower than a certain threshold, and the range of the impedance threshold for reference is 20,000 ohms to 50,000 ohms. The EEG amplifier amplifies the weak EEG signal, performs digital-to-analog conversion, and transmits the digital signal to the processor module.

[0066] In the specific implementation, t...

Embodiment 3

[0081] A mobile wearable human-computer interaction system combining brain-computer interface, near-eye display and machine vision, comprising: a brain-computer control unit, collecting EEG signals through electrodes placed on the surface of the scalp, decoding the EEG signals to identify user control intention;

[0082] A near-eye display unit that displays the visual stimuli required for the interactive interface and the brain-computer interface;

[0083] A machine vision unit that identifies controllable devices in the environment;

[0084] The mobile wearable human-computer interaction system combining brain-computer interface, near-eye display and machine vision realizes the control of external equipment based on brain control and does not rely on limbs in a mobile environment.

[0085] The system is based on the hardware modules in Embodiments 1 and 2, and the above-mentioned hardware in Embodiments 1 and 2 functionally constitutes a brain-computer control module, a nea...

technical field

[0001] The present invention relates to the field of human-computer interaction, in particular to a wearable brain-computer interface device, a human-computer interaction system and a method. Background technique

[0002] Brain-computer interface (BCI) is a new external information exchange and control technology that establishes a new external information exchange and control technology between the human brain and a computer or other electronic devices that does not rely on conventional brain information output pathways. Electroencephalography (EEG) is widely used in non-invasive BCI due to its advantages of high temporal resolution, easy acquisition, and low price. At present, the EEG signal components or types commonly used in BCI mainly include: event related synchronization / desynchronization (ERS / ERD), steady-state visual evoked potentials (SSVEP), Slow cortical potentials (slow cortical potentials, SCP), P300 and μ rhythm, β rhythm and so on.

[0003] ...

Examples

Embodiment 1

[0052] A portable brain-computer interface device, see figure 1 The hardware of the device includes: an EEG acquisition module, a display module, a sensor module, a processor module, a power supply module (not shown in the figure), a communication module and other modules, each of which is connected to the processor module and processed by controller module control. The whole device is integrated and worn on the user's head.

[0053] Among them, the EEG acquisition module includes: EEG electrodes and EEG amplifiers, etc., which are used for collecting (that is, collecting through EEG electrodes) and releasing EEG signals (that is, amplifying EEG signals through EEG amplifiers), The amplified EEG signal is digital-to-analog converted. The EEG acquisition module is controlled by the processor module and sends the collected EEG signals to the processor module.

[0054] Further, the display module includes: a micro-projector, a prism, etc., used for near-eye display of visual s...

Embodiment 2

[0061] The solution in Embodiment 1 is further introduced below in conjunction with specific devices, and details are described below:

[0062] 1. EEG acquisition module:

[0063] The EEG acquisition module includes: EEG electrodes and EEG amplifiers. EEG electrodes can be dry electrodes or wet electrodes, and the covered areas should include: visual cortex, forehead, top of the head, etc.

[0064] The available lead configurations are: POz, PO3, PO4, PO5, PO6, Oz, O1, O2, with the reference electrode placed on the top of the head and the ground electrode placed on the forehead.

[0065] During use, the impedance between each electrode and the reference electrode should be lower than a certain threshold, and the range of the impedance threshold for reference is 20,000 ohms to 50,000 ohms. The EEG amplifier amplifies the weak EEG signal, performs digital-to-analog conversion, and transmits the digital signal to the processor module.

[0066] In the specific implementation, t...

Embodiment 3

[0081] A mobile wearable human-computer interaction system combining brain-computer interface, near-eye display and machine vision, comprising: a brain-computer control unit, collecting EEG signals through electrodes placed on the surface of the scalp, decoding the EEG signals to identify user control intention;

[0082] A near-eye display unit that displays the visual stimuli required for the interactive interface and the brain-computer interface;

[0083] A machine vision unit that identifies controllable devices in the environment;

[0084] The mobile wearable human-computer interaction system combining brain-computer interface, near-eye display and machine vision realizes the control of external equipment based on brain control and does not rely on limbs in a mobile environment.

[0085] The system is based on the hardware modules in Embodiments 1 and 2, and the above-mentioned hardware in Embodiments 1 and 2 functionally constitutes a brain-computer control module, a nea...

Images