Multi-aircraft flight path planning method based on deep Q learning algorithm

A trajectory planning and learning algorithm technology, applied in the direction of instruments, three-dimensional position/course control, vehicle position/route/altitude control, etc., can solve the complexity, combination complexity and time complexity of multi-aircraft cooperative trajectory modeling Increase and other issues to achieve the ability to solve high-dimensional perception decision-making, high real-time performance, and enhance the overall combat effect

Pending Publication Date: 2020-03-27
BEIJING SPACE TECH RES & TEST CENT
View PDF2 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Coupled with the complex and changeable battlefield environment and the correlation coupling of various influencing factors, the compl

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-aircraft flight path planning method based on deep Q learning algorithm
  • Multi-aircraft flight path planning method based on deep Q learning algorithm
  • Multi-aircraft flight path planning method based on deep Q learning algorithm

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0049] Such as figure 1 As shown, according to an embodiment of the present invention, a multi-aircraft trajectory planning method based on a deep Q learning algorithm of the present invention includes:

[0050] S1. Construct a kinematic model of the aircraft based on the performance of the aircraft;

[0051] S2. Construct a mission model of the aircraft according to the target to be hit and based on a deep Q learning algorithm;

[0052] S3. Construct the state space of the aircraft according to the kinematic model and mission model;

[0053] S4. Construct the action space of the aircraft according to the kinematic model and mission model;

[0054] S5. Construct a neural network and reward function based on the deep Q learning algorithm based on the state space and the action space;

[0055] S6. Training the neural network based on the reward function;

[0056] S7. Perform target strike verification on the trained neural network.

[0057] According to an embodiment of the present inventi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a multi-aircraft flight path planning method based on a deep Q learning algorithm. The method comprises the following steps: S1, constructing a kinematic model of an aircraftbased on the performance of the aircraft; S2, constructing a task model of the aircraft based on a deep Q learning algorithm according to a to-be-hit target; S3, constructing a state space of the aircraft according to the kinematics model and the task model; S4, constructing an action space of the aircraft according to the kinematics model and the task model; S5, constructing a neural network anda reward function based on the deep Q learning algorithm based on the state space and the action space; S6, training the neural network based on the reward function; and S7, performing target strike verification on the trained neural network. And multi-aircraft cooperative flight path planning is completed through a deep Q learning algorithm, and target strike under the constraints of minimum energy loss, shortest strike time, air defense threat area avoidance and the like is realized.

Description

technical field [0001] The invention relates to the technical field of multi-aircraft cooperative track planning, in particular to a multi-aircraft track planning method based on a deep Q-learning algorithm. Background technique [0002] In future wars, the battlefield environment will become increasingly complex and the performance of various defense systems will be improved day by day. The war has transitioned from a confrontation between individual weapons to a confrontation between systems. In this context, multi-aircraft coordinated operations have become a new form of combat. Specifically, coordinated operations require all aircraft to share, distribute and organize combat information and combat resources, and then make quick and accurate decisions to complete tasks such as coordinated reconnaissance, coordinated attack, and coordinated interception. [0003] From a system perspective, the key to realizing multi-aircraft cooperative operations lies in effective missio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G05D1/10
CPCG05D1/0088G05D1/104Y02T90/00
Inventor 张伸侯砚泽陈冲王开强李宪强付新卫刘昶秀陈润峰杨格
Owner BEIJING SPACE TECH RES & TEST CENT
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products