Wearable display-based asynchronous type brain-controlled unmanned aerial vehicle system

Abstract

The present invention discloses a wearable display-based asynchronous type brain-controlled unmanned aerial vehicle system. A wearable display is utilized to display a group of visual stimulation units which flick with different frequencies; the visual stimulation units are corresponding to one group of different operation instructions of an unmanned aerial vehicle; a user gazes at different visual stimulation units, so that brain electrical signals can be generated, and the brain electrical signals are processed, so that the visual stimulation units which are gazed by the user and operation instructions corresponding to the visual stimulation units are identified; identification results are sent to the unmanned aerial vehicle end so as to be executed; the real-time scene pictures of the unmanned aerial vehicle are transmitted to the ground and are superimposed with the visual stimulation units, and superimposition results are displayed on the wearable display; and therefore, first-person perspective feedback can be provided for the user, and the portability of a steady-state vision-induced electric potential brain-computer interface system can be improved. According to the wearable display-based asynchronous type brain-controlled unmanned aerial vehicle system of the invention, an idle state can be fully utilized to perform decoding, and therefore, operational burden and fatigue feeling caused by using a brain-computer interface to control flight can be greatly decreased, and more free flight experience can be brought to the user.

Description

technical field [0001] The invention belongs to the technical fields of biomedical engineering and automatic control, in particular, it relates to a steady-state visual evoked potential presentation method and a brain-computer interface asynchronous control drone flight system based on it, especially a wearable display-based Asynchronous brain-controlled UAV system. Background technique [0002] Brain-computer interface is a technology that can realize the interaction between human and the outside world without relying on external muscles. It can help patients with limited mobility, paralysis, and stroke to re-establish contact with the outside world, express their wishes, and assist in daily life. The asynchronous brain-computer interface allows the system to follow the patient's wishes, rather than the patient following the system's orders, which has great potential use value and development prospects. Commonly used EEG patterns include motor imagery, steady-state visual...

AI Technical Summary

Problems solved by technology

However, the existing drones generally use remote control or flight ground software, which is not easy to use for people with handicapped hands and feet, and they often have more urgent needs than able-bodied people.

[0005] The "UAV control method based on steady-state visual evoked potential" of Southeast University and "an aircraft control device based on steady-state visual method and device, but the visual stimulation unit is still located at a certain distance directly in front of the user, which affects the user's sense of participation; in addition, the user needs to keep looking at the block when flying in a certain direction, due to the steady state The visual evoked stimulation unit itself will bring fatigue to the user, and long-term staring will bring a strong sense of flickering and fatigue to the user, which reduces the ease of use of the system and the user's recognition of the system. Over time, Users will become less and less willing to use the system

Images