Wearable augmented reality robot control system combining eye movement and brain-computer interface

Abstract

The invention discloses a wearable augmented reality robot control system combining eye movement and a brain-computer interface. The wearable augmented reality robot control system can be applied to the fields of human-computer interaction, robot control and the like. The system is composed of augmented reality glasses, an eye movement module, a brain-computer interface module and a control module. The augmented reality glasses are used for providing an interactive interface of eye movement and a brain-computer interface. The eye movement module collects eye movement information of personnel.The brain-computer interface collects electroencephalogram information of personnel, and the control module jointly inputs the information collected by the two modules into the neural network model tocomprehensively predict the control intention of the personnel and obtain a personnel control instruction. By utilizing the system provided by the invention, the selection of a plurality of robot operation instructions can be quickly dealt with, a robust and accurate augmented reality control technology is provided for the robot, and the system can adapt to various application scenes.

Description

technical field [0001] The invention relates to the fields of human-computer interaction, augmented reality, brain-computer interface, etc., and in particular to a wearable augmented reality robot control system combining eye movement and brain-computer interface. Background technique [0002] Augmented reality glasses are the representative of the next generation of smart terminals. Compared with personal computers, smart phones and other terminals, the information displayed by augmented reality glasses is richer, more three-dimensional and more convenient; on the other hand, with the continuous development of robots, robots will be integrated into human Therefore, designing a robot control system suitable for wearable augmented reality interaction is a hot research issue in the field of human-computer interaction. Eye movement interaction and brain-computer interface interaction are the key interaction modes of wearable augmented reality systems, similar to the mouse and k...

AI Technical Summary

Problems solved by technology

Among them, the advantage of eye movement interaction is that the interaction is natural, and personnel can perform various operations in the augmented reality device without redundant operations. However, the accuracy of eye movement interaction is currently low, especially after personnel adjust the augmented reality Can localize to a local area, but cannot precisely locate an interaction point

Brain-computer interface is an emerging interaction mode. With the continuous development of EEG equipment, the brain-computer interface can accurately capture the person's response to specific frequency visual stimuli. At present, the number of selection frequencies that can be dealt with is small, and it is difficult to extend to complex application scenarios

Images