Hesitant fuzzy and dynamic deep reinforcement learning combined unmanned aerial vehicle maneuvering decision-making method

A technology of reinforcement learning and decision-making methods, applied in multi-objective optimization, design optimization/simulation, CAD numerical modeling, etc., can solve problems such as fuzzy and inaccurate optimization target parameters, and achieve reasonable decision-making results

Pending Publication Date: 2020-09-15
NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF0 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the actual air combat decision-making process, different air combat situations have different requirements for environmenta

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hesitant fuzzy and dynamic deep reinforcement learning combined unmanned aerial vehicle maneuvering decision-making method
  • Hesitant fuzzy and dynamic deep reinforcement learning combined unmanned aerial vehicle maneuvering decision-making method
  • Hesitant fuzzy and dynamic deep reinforcement learning combined unmanned aerial vehicle maneuvering decision-making method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] The technical solution of the present invention is described in detail in combination with the accompanying drawings.

[0026] The UAV maneuver decision-making method combining hesitant fuzzy and dynamic deep reinforcement learning of the present invention specifically includes the following steps:

[0027] Step 1, establish the UAV air combat movement model, according to the missile attack parameters ξ of both the enemy and the enemy i , ξ T and the energy parameter difference ΔW based on the situation, establish a decision-making model based on the weighted optimization objective, specifically:

[0028] (1.1) The UCAV is regarded as a particle, regardless of the specific rigid body motion and flight control algorithm, the three-degree-of-freedom particle model is used to describe its motion state, and its motion model is:

[0029]

[0030] In the formula, x, y, z represent the position of the aircraft in the inertial coordinate system, v is the flight speed of th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a hesitant fuzzy and dynamic deep reinforcement learning combined unmanned aerial vehicle maneuvering decision-making method, which comprises the steps of firstly, establishingan unmanned aerial vehicle air combat motion model, and establishing a decision-making model based on a weighted optimization target according to attack parameters of friends and my parties and an energy parameter difference based on a situation; secondly, according to a hesitant fuzzy theory, determining an optimal weight of a decision model of an optimization target in real time by adopting a maximum deviation method; then, constructing a state space and an action space of air combat maneuver decision reinforcement learning; then, combining the unmanned aerial vehicle states at multiple moments into a state set as neural network input, and constructing a dynamic deep Q network to perform unmanned aerial vehicle maneuvering decision training; and finally, obtaining an optimal maneuveringdecision through the trained dynamic deep Q network. The hesitant fuzzy and dynamic deep reinforcement learning combined unmanned aerial vehicle maneuvering decision-making method mainly solves the problem of maneuvering decision making of the unmanned aerial vehicle under the condition of incomplete environmental information, considers the influence of the air combat process in the decision making process, and better meets the requirements of actual air combat.

Description

technical field [0001] The invention belongs to the field of UAV air combat decision-making, in particular to a UAV maneuver decision-making method combining hesitant fuzzy and dynamic deep reinforcement learning. [0002] technical background [0003] Unmanned combat aircraft (Unmanned Combat Aerial Vehicle, UCAV) needs to decide the optimal tactical plan or maneuver based on the complex battlefield situation information in the process of air combat. The essential. As the air combat environment becomes more and more complex and unknown, improving the intelligence level of UAVs so that UAVs can independently perceive the battlefield environment and automatically generate control commands to complete the maneuver selection in air combat is the main research direction of UAV air combat. [0004] In recent years, with the rapid development of artificial intelligence technology, deep learning and machine learning have shown great potential in the field of UAV air combat decision...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F30/15G06F30/27G06F111/10G06F111/04G06F111/06G06F119/14
CPCG06F30/15G06F30/27G06F2111/04G06F2111/06G06F2111/10G06F2119/14
Inventor 丁勇何金
Owner NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products