Unmanned aerial vehicle cluster target defense method based on deep reinforcement learning

A technology of reinforcement learning and unmanned aerial vehicles, applied in neural learning methods, simulators, simulation devices for space navigation conditions, etc.

Active Publication Date: 2020-06-09
NORTHWESTERN POLYTECHNICAL UNIV
View PDF6 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Judging from the achievements of the coordinated missions of UAV clusters realized in China, my country's UAV clusters have more research on how to effectively prevent collisions when UAV clusters perform tasks collaboratively, and the payload of UAVs and its execution are more complex. High-level tasks, such as: coordinated detection, coordinated attack, coordinated defense and other task-level related research are still relatively few

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unmanned aerial vehicle cluster target defense method based on deep reinforcement learning
  • Unmanned aerial vehicle cluster target defense method based on deep reinforcement learning
  • Unmanned aerial vehicle cluster target defense method based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0053] Such as figure 1 Shown, concrete steps of the present invention are as follows:

[0054] Step 1: The specific steps of the training phase are as follows:

[0055] Step 1-1: Initialize the state of the incoming target in the designated area of ​​the strategic target scene to be defended, and obtain the initial position information and behavior information of the incoming target; the number of initialization is m uav The UAVs clustered around the defense target of one's own side, gaining m uav The status information of the UAV, the status information includes the position (x i ,y i ), i=1...m uav and speed In the present invention, the environment is a continuous environment data unit of 200*200, the defended target of one's own side moves horizontally to the right at a speed of v=3, 10 unmanned aerial vehicles are initialized in the surroun...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an unmanned aerial vehicle cluster target defense method based on deep reinforcement learning. In the training stage, initial position information and behavior information of anattacking target are obtained, a training neural network of deep reinforcement learning is established, the neural network is trained, in the execution stage, an unmanned aerial vehicle cluster stateand a target state are obtained and input into the trained deep neural network, and an output result is judged. According to the method, the state space and the behavior space of the unmanned aerialvehicle clustering task are expanded, the task-oriented unmanned aerial vehicle clustering unified decision network is constructed, and unified command and control of the decision network on the uncertain number of unmanned aerial vehicles are realized.

Description

technical field [0001] The invention relates to the fields of machine learning, path planning and target confrontation, in particular to an unmanned swarm target defense method. Background technique [0002] Nowadays, the research on UAV swarms has attracted more and more attention from everyone, and has made certain progress in the direction of UAV swarm mission decision-making, information interaction and information fusion between UAVs, collaborative detection, path planning, and interaction methods. As a result of the research, among the mission sequences of many UAV swarms, the defense mission is the most important thing that cannot be bypassed. In the battlefield environment, it is often necessary to defend one's own important strategic goals and prevent enemy targets from attacking. Therefore, deploying drones around the base to prevent possible enemy attacks will become a drone cluster. one of the important tasks. [0003] The current research on the behavior contr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/04G06N3/08G09B9/00
CPCG06N3/08G09B9/003G06N3/045
Inventor 张耀中许佳林姚康佳张建东史国庆吴勇
Owner NORTHWESTERN POLYTECHNICAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products