Unmanned aerial vehicle autonomous air combat decision framework and method

A technology of unmanned aerial vehicles and air combat, which is applied in the field of computer simulation, can solve problems such as difficulty in obtaining new knowledge and decision-making quality, and achieve the effects of avoiding the correlation problem before and after recording, good accuracy, and strong expressive ability

Inactive Publication Date: 2018-05-11
BEIHANG UNIV
View PDF3 Cites 41 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the main problem of the knowledge decision-making system is that it is difficult to continuously acquire new

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unmanned aerial vehicle autonomous air combat decision framework and method
  • Unmanned aerial vehicle autonomous air combat decision framework and method
  • Unmanned aerial vehicle autonomous air combat decision framework and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] The technical solution of the present invention will be specifically described below in conjunction with the accompanying drawings.

[0030] The present invention is a hybrid UAV autonomous air combat decision-making framework based on domain knowledge, deep network and reinforcement learning. figure 1 As shown, the framework includes domain knowledge-based air combat decision-making module 1, deep network learning module 2, reinforcement learning module 3 and air combat simulation environment 4.

[0031] Domain knowledge-based air combat decision-making module 1 is the producer of air combat training data sets. Domain knowledge-based air combat decision-making module 1 uses production rules as the decision-making subject, and the production rules come from the research of experts in the field of air combat. The domain knowledge-based air combat decision-making module 1 takes the current combat situation as input and outputs the maneuvers to be executed to form an air ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an unmanned aerial vehicle autonomous air combat decision framework and method, and belongs to the field of computer simulation. The framework comprises an air combat decisionmodule, a deep network learning module, an enhanced learning module and an air combat simulation environment which are based on domain knowledge. The air combat decision module generates an air combattraining data set and outputs the air combat training data set to the deep network learning module, and a depth network, a Q value fitting function and a motion selection function are obtained through learning and output to the enhanced learning module; the air combat simulation environment uses the learned air combat decision function to carry out a self-air combat process, and records air combat process data to form an enhanced learning training set; the enhanced learning module is used for optimizing and improving the Q value fitting function by utilizing the enhanced learning training set, and an air combat strategy with better performance is obtained. According to the framework, a Q function which is complex in nature can be more accurately and quickly fitted, the learning effect isimproved, the Q function is prevented from being converged to the local optimum value to the largest extent, an air combat decision optimization closed-loop process is constructed, and external intervention is not needed.

Description

technical field [0001] The invention belongs to the field of computer simulation, and in particular relates to a framework and method for autonomous air combat decision-making of an unmanned aerial vehicle. Background technique [0002] With the large number of applications of UAVs in the military field, how to establish a high-performance UAV autonomous decision-making method framework has become the key to promoting the deployment of UAVs to further undertake complex tasks and improve application efficiency. The UAV autonomous air combat decision-making method decides its own maneuver or tactical action according to its own mission deployment, threat situation and load configuration, so as to achieve the goal of completing combat missions at the minimum cost. [0003] The decision-making technology based on domain knowledge is the main traditional way to realize autonomous air combat decision-making, and it has the practical characteristics of being easy to construct. How...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/50G06N3/08G06N5/02
CPCG06N3/08G06N5/022G06F30/20
Inventor 马耀飞刘品陈静心李妮龚光红
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products