A aerospace weapon interface based on virtual reality and multi -mode man -machine interface

Abstract

A spacecraft rendezvous and docking method based on virtual reality and multi-modal human-machine interface. The invention discloses an aircraft rendezvous and docking method and system based on virtual reality technology and a multi-modal man-machine interface. Three-dimensional modeling; collection of EEG signals, EMG signals and hand position parameter information; preprocessing of collected EEG signals, EMG signals and hand position parameter information; EEG signal, EMG signal and hand position parameter information Perform feature extraction; generate corresponding control commands based on the parameters extracted from the features, and adjust the position and attitude of the docking aircraft; calculate the real-time attitude and position changes of the docking aircraft in real time and feed them back to the astronauts, so that the astronauts can feel the position and attitude of the spacecraft. Variety. By directly converting the brain and limb movement intention information into aircraft control information, it can better assist astronauts to complete the manual RVD task.

Description

technical field [0001] The invention relates to the field of manned spaceflight, and more specifically, relates to a method for rendezvous and docking of an aircraft based on virtual reality technology and a multi-modal man-machine interface. Background technique [0002] Space rendezvous and docking (Rendezvous and Docking, RVD) refers to the meeting of two or more aircraft at a predetermined time and position on the orbit, and after the meeting, they are structurally connected as a whole. The results of RVD often determine the success or failure of advanced space operations such as space assembly and maintenance, on-orbit assembly, recovery of products and waste, refueling and resupply supplies, interstellar lifeboats, and astronaut rotation and rescue. Therefore, with the development of aerospace technology, RVD has become an important space technology. In essence, RVD can be divided into two ways: autonomous RVD and manual RVD. Among them, the United States mainly adopt...

AI Technical Summary

Problems solved by technology

However, in the state of weightlessness, astronauts will encounter the following problems: first, the ability of space-earth proprioception, space perception, space orientation, and direction recognition formed by astronauts on the ground will be significantly reduced; Judging TV camera image information, tracking screen data, hand-eye-brain coordination, and other aspects of ability have also declined, and psychological pressure has increased. Planar target images are used to complete real 3D target docking and aircraft attitude adjustment. The human-computer interaction interface has shortcomings such as non-intuitive and lack of visual stereoscopic effect.

It can be said that the existing human-computer interaction technology of hand-controlled RVD will make the astronauts bear a large workload and psychological load.

Images