Multi-mode brain-computer interaction technology-based virtual sand table interaction control system

Abstract

The invention discloses a multi-mode brain-computer interaction technology-based virtual sand table interaction control system. The system comprises an electroencephalogram module, a myoelectricity module, an eye movement module, a control module and a display module, wherein the control module is connected with each of the electroencephalogram module, the myoelectricity module, the eye movement module and the display module; the electroencephalogram module is connected with the myoelectricity module; the electroencephalogram module is used for overlapping a user glare on a virtual sand tablecontrol menu and sending a control command to the control module; the myoelectricity module is used for sending a continuous control instruction to the control module; the eye movement module is usedfor sending a user glare direction coordinate to the control module; the control module is used for sending a digital sand table updating content to the display module; and the display module is usedfor displaying a virtual sand table and a user sight fixation point, and overlapping fixed-frequency visual stimulations encoded at different frequencies on the virtual sand table control menu. According to the method, a brain-computer interface and eye tracker combined multi-mode brain-computer interaction method is used for realizing function key selection of the control menu, so that the targetselection performance is more stable and the system is suitable for multiple application scenes.

Description

technical field [0001] The present invention mainly relates to the technical field of brain-computer interface and virtual reality, in particular to a virtual sand table control system based on multi-modal brain-computer interaction technology. Background technique [0002] The sand table model is an intuitive representation of the terrain, landforms, and features in a certain spatial area according to a specific scale. It is widely used in many fields such as urban planning and design, environmental governance, architectural design, and agricultural planning. It is used to show its unique Regional characteristics. With the maturity of related technologies, the sand table is also developing in the direction of diversified functions, intelligence and personalization. Among them, the virtual sand table is an immersive geospatial interactive presentation system constructed using electronic map visualization and 3D virtual simulation technology. Compared with the traditional s...

AI Technical Summary

Problems solved by technology

As far as we know, there have been no related reports on the interactive control method of virtual sand table based on multi-modal brain-computer interaction technology.

Images