Wearable display-based asynchronous type brain-controlled unmanned aerial vehicle system

A technology for wearable displays and drones, applied in control/adjustment systems, instruments, attitude control, etc., can solve problems that affect user participation, users are unwilling to use the system, and reduce the system's usability and system acceptance , to achieve the effect of reducing the operating burden and fatigue

Inactive Publication Date: 2017-09-15
SHANGHAI JIAO TONG UNIV
View PDF4 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing drones generally use remote control or flight ground software, which is not easy to use for people with handicapped hands and feet, and they often have more urgent needs than able-bodied people.
[0005] The "UAV control method based on steady-state visual evoked potential" of Southeast University and "an aircraft control device based on steady-state visual method and device, but the visual stimulation unit is still located at a certain distance directly in front of

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Wearable display-based asynchronous type brain-controlled unmanned aerial vehicle system
  • Wearable display-based asynchronous type brain-controlled unmanned aerial vehicle system
  • Wearable display-based asynchronous type brain-controlled unmanned aerial vehicle system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0041] The asynchronous brain-controlled unmanned aerial vehicle system based on the wearable display provided in this embodiment adopts a steady-state visually evoked stimulation unit (potential), and uses a wearable display to present a group of visual stimulation subunits flashing at different frequencies, respectively corresponding to no A set of different operation instructions of the man-machine, the user looks at different visual stimulation sub-units, the resulting EEG signals are processed and the stimulation sub-units and their corresponding operation instructions that the user is looking at are identified, and the recognition results are Send it to the drone for execution, and the real-time scene of the drone is sent back to the ground, superimposed with the steady-state visual evoked stimulation unit, displayed on the wearable display, and provides the user with first-person perspective feedback; also by designing an asynchronous The paradigm of controlled flight is...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention discloses a wearable display-based asynchronous type brain-controlled unmanned aerial vehicle system. A wearable display is utilized to display a group of visual stimulation units which flick with different frequencies; the visual stimulation units are corresponding to one group of different operation instructions of an unmanned aerial vehicle; a user gazes at different visual stimulation units, so that brain electrical signals can be generated, and the brain electrical signals are processed, so that the visual stimulation units which are gazed by the user and operation instructions corresponding to the visual stimulation units are identified; identification results are sent to the unmanned aerial vehicle end so as to be executed; the real-time scene pictures of the unmanned aerial vehicle are transmitted to the ground and are superimposed with the visual stimulation units, and superimposition results are displayed on the wearable display; and therefore, first-person perspective feedback can be provided for the user, and the portability of a steady-state vision-induced electric potential brain-computer interface system can be improved. According to the wearable display-based asynchronous type brain-controlled unmanned aerial vehicle system of the invention, an idle state can be fully utilized to perform decoding, and therefore, operational burden and fatigue feeling caused by using a brain-computer interface to control flight can be greatly decreased, and more free flight experience can be brought to the user.

Description

technical field [0001] The invention belongs to the technical fields of biomedical engineering and automatic control, in particular, it relates to a steady-state visual evoked potential presentation method and a brain-computer interface asynchronous control drone flight system based on it, especially a wearable display-based Asynchronous brain-controlled UAV system. Background technique [0002] Brain-computer interface is a technology that can realize the interaction between human and the outside world without relying on external muscles. It can help patients with limited mobility, paralysis, and stroke to re-establish contact with the outside world, express their wishes, and assist in daily life. The asynchronous brain-computer interface allows the system to follow the patient's wishes, rather than the patient following the system's orders, which has great potential use value and development prospects. Commonly used EEG patterns include motor imagery, steady-state visual...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G05D1/08G05D1/10G06F3/01
CPCG05D1/0808G05D1/101G06F3/015G06F2203/011
Inventor 张定国王萌李仁杰徐瑜健何文谦
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products