Human-computer interaction control semi-physical simulation system and method for multi-modal unmanned aerial vehicle

A semi-physical simulation, machine-man-machine technology, applied in the field of drones, can solve problems such as unrealistic simulation, uncontrollable command correction, etc., to achieve the effect of improving reliability and avoiding false triggering

Pending Publication Date: 2018-12-25
赵小川
View PDF0 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the existing technology, only the simulation of the flight process of the UAV controlled by the ground control station can be realized, and the simulation of the flight process of the operator's EEG and gesture control under the control of multiple modes cannot be realized, so that the man-machine cannot be simulated. Interactive control instructions are corrected in a targeted manner, thereby improving the reliability of recognition and avoiding false triggers

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human-computer interaction control semi-physical simulation system and method for multi-modal unmanned aerial vehicle
  • Human-computer interaction control semi-physical simulation system and method for multi-modal unmanned aerial vehicle

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0041] Example 1, such as figure 1 As shown, a semi-physical simulation system for multi-modal UAV human-computer interaction control, including: gesture recognition equipment, EEG signal measurement equipment, remote control, simulation host computer, ground control station and airborne processor, wherein, Gesture recognition equipment, EEG signal measurement equipment, and remote controllers enable multimodal control of drones.

[0042] The onboard processor is mounted on the UAV to receive control commands sent by gesture recognition equipment, EEG signal measurement equipment, and remote control receivers, as well as characteristic control commands issued by the ground control station, and follow the corresponding control commands or specific control commands. Command to control the UAV, and transmit the control command to the ground control station and the simulation host computer through the serial port communication module.

[0043] The gesture recognition device is co...

Embodiment 2

[0056] Embodiment 2, a kind of multi-mode unmanned aerial vehicle human-computer interaction control semi-physical simulation method, comprising:

[0057] Step 1. The gesture recognition device collects the operator's gesture signal, acquires the operator's gesture information, realizes the operator's gesture recognition, and converts the gesture information into a control command for the drone. The transfer module receives and processes the gesture recognition The control command protocol sent by the device is converted into a mavlink command recognizable by the onboard processor, and sent to the onboard processor through the serial communication module;

[0058] Step 2. The EEG signal measurement equipment collects the operator's EEG signal, obtains the operator's brain thinking information, and converts the brain thinking information into control instructions for the drone, and the transfer module receives and processes the EEG signal measurement equipment The sent control ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a human-computer interaction control semi-physical simulation system for multi-modal unmanned aerial vehicle, which comprises: an airborne processor, which is mounted on an unmanned aerial vehicle; a gesture recognition device and an electroencephalogram signal measuring device, which are connected to a switching module through a serial communication module, and the switching module is connected to the airborne processor; a remote controller, which is connected to the airborne processor through a PPM interface; a simulation upper computer, which is equipped with an AirSim simulator and is connected to the onboard processor through the serial communication module; a ground control station, which is connected to the airborne processor through the serial communicationmodule, and is connected to the simulation upper computer through an UDP protocol. The invention further discloses a human-computer interaction control semi-physical simulation method for multi-modalunmanned aerial vehicle. The invention has the advantages that the electroencephalogram and gesture control, remote controller control, and the simulation of the flight process of the unmanned aerialvehicle under various modal control are realized, and the simulation of the flight process of the unmanned aerial vehicle controlled by the ground control station can also be realized.

Description

technical field [0001] The invention relates to the technical field of unmanned aerial vehicles, in particular to a semi-physical simulation system and method for human-computer interaction control of multi-mode unmanned aerial vehicles. Background technique [0002] As a simulated aircraft attack target, UAV can provide air targets for the fire control radar flight calibration and shooting tasks of the air defense weapon system, and is an indispensable equipment in the development and identification process of the weapon system. As one of the core components of the UAV, the flight control system completes the flight tasks of the UAV in various modes by controlling the attitude of the UAV. In the development process of drones, human-computer interaction is a very important link. Gesture recognition and EEG control technology is a key technology of the new generation of natural human-computer interaction. Compared with traditional mouse, keyboard and other contact operation ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G05B17/02
CPCG05B17/02
Inventor 赵小川
Owner 赵小川
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap