Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A UAV Swarm Target Defense Method Based on Deep Reinforcement Learning

A technology of reinforcement learning and unmanned aerial vehicles, applied in neural learning methods, simulators, simulation devices for space navigation conditions, etc., to achieve the effect of expanding the state space and expanding the behavior space

Active Publication Date: 2022-03-01
NORTHWESTERN POLYTECHNICAL UNIV
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Judging from the achievements of the coordinated missions of UAV clusters realized in China, my country's UAV clusters have more research on how to effectively prevent collisions when UAV clusters perform tasks collaboratively, and the payload of UAVs and its execution are more complex. High-level tasks, such as: coordinated detection, coordinated attack, coordinated defense and other task-level related research are still relatively few

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A UAV Swarm Target Defense Method Based on Deep Reinforcement Learning
  • A UAV Swarm Target Defense Method Based on Deep Reinforcement Learning
  • A UAV Swarm Target Defense Method Based on Deep Reinforcement Learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0053] Such as figure 1 Shown, concrete steps of the present invention are as follows:

[0054] Step 1: The specific steps of the training phase are as follows:

[0055] Step 1-1: Initialize the state of the incoming target in the designated area of ​​the strategic target scene to be defended, and obtain the initial position information and behavior information of the incoming target; the number of initialization is m uav The UAVs clustered around the defense target of one's own side, gaining m uav The status information of the UAV, the status information includes the position (x i ,y i ), i=1...m uav and speed In the present invention, the environment is a continuous environment data unit of 200*200, the defended target of one's own side moves horizontally to the right at a speed of v=3, 10 unmanned aerial vehicles are initialized in the surroun...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a UAV cluster target defense method based on deep reinforcement learning. In the training stage, the initial position information and behavior information of the incoming target are obtained, and a deep reinforcement learning training neural network is established, and the neural network is trained. In the execution stage, the The UAV cluster status and target status are input to the trained deep neural network, and the output results are judged. The invention expands the state space and behavior space of the UAV cluster task, constructs a unified decision-making network for the task-oriented UAV cluster, and realizes the unified command and control of the decision-making network for an indefinite number of UAVs.

Description

technical field [0001] The invention relates to the fields of machine learning, path planning and target confrontation, in particular to an unmanned swarm target defense method. Background technique [0002] Nowadays, the research on UAV swarms has attracted more and more attention from everyone, and has made certain progress in the direction of UAV swarm mission decision-making, information interaction and information fusion between UAVs, collaborative detection, path planning, and interaction methods. As a result of the research, among the mission sequences of many UAV swarms, the defense mission is the most important thing that cannot be bypassed. In the battlefield environment, it is often necessary to defend one's own important strategic goals and prevent enemy targets from attacking. Therefore, deploying drones around the base to prevent possible enemy attacks will become a drone cluster. one of the important tasks. [0003] The current research on the behavior contr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06N3/04G06N3/08G09B9/00
CPCG06N3/08G09B9/003G06N3/045
Inventor 张耀中许佳林姚康佳张建东史国庆吴勇
Owner NORTHWESTERN POLYTECHNICAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products