Brain-eye collaborative control method and system in an augmented reality environment

Abstract

Provided is a method and a system for brain-eye coordinated control in an augmented reality environment. For the need of astronauts for portable operation, the structures of a helmet-mounted display and a view tracking eye movement instrument are integrated. First, an integrated embedded augmented reality operation environment matching a digital helmet is developed to realize manipulator degree-of-freedom selection and action pre-selection based on eye movement tracking. Then, stable intention understanding and precise control of the six-degrees-of-freedom control action of the manipulator areimplemented by identifying the steady-state visual evoked control information of a brain machine interface. Finally, under the condition of a digital integrated helmet, a controlled object is controlled by an electroencephalogram signal and a visual tracking signal in a coordinated manner. Compared with the prior art, the problem that the control ability is weak and the robustness and stability are insufficient for the control based on a pure electroencephalogram signal is solved, and the method and the system are of good use value.

Description

technical field [0001] The invention relates to the field of human-machine fusion control, in particular to a brain-eye cooperative control method and system in an augmented reality environment. Background technique [0002] In my country's future manned spaceflight projects, astronauts' on-orbit tasks (such as space station, large-scale space science experiment platform and other spacecraft on-orbit repair, assembly, and maintenance tasks) are increasing day by day, requiring astronauts to wear space suits to go out of the cabin for spacewalking. Task requirements continue to increase, and the complexity and arduousness of operations will far exceed the current ones. [0003] Astronauts face limited individual ability during out-of-cabin operations under conditions such as weightlessness and limited individual movement, limited conventional control channels under spacesuit conditions, insufficient control channels for auxiliary operation systems, insufficient operational vis...

AI Technical Summary

Problems solved by technology

[0004] The technical problem solved by the present invention is: to overcome the deficiencies of the prior art, to provide a brain-eye collaborative control method and system in an augmented reality environment, to solve the problem of insufficient operation information in the man-machine collaborative operation of astronauts out of the cabin, and to realize Man-Machine-Environment Performance Enhancements for Astronaut Mission Operations

Images