Unmanned aerial vehicle autonomous air combat decision framework and method

Abstract

The invention discloses an unmanned aerial vehicle autonomous air combat decision framework and method, and belongs to the field of computer simulation. The framework comprises an air combat decisionmodule, a deep network learning module, an enhanced learning module and an air combat simulation environment which are based on domain knowledge. The air combat decision module generates an air combattraining data set and outputs the air combat training data set to the deep network learning module, and a depth network, a Q value fitting function and a motion selection function are obtained through learning and output to the enhanced learning module; the air combat simulation environment uses the learned air combat decision function to carry out a self-air combat process, and records air combat process data to form an enhanced learning training set; the enhanced learning module is used for optimizing and improving the Q value fitting function by utilizing the enhanced learning training set, and an air combat strategy with better performance is obtained. According to the framework, a Q function which is complex in nature can be more accurately and quickly fitted, the learning effect isimproved, the Q function is prevented from being converged to the local optimum value to the largest extent, an air combat decision optimization closed-loop process is constructed, and external intervention is not needed.

Description

technical field [0001] The invention belongs to the field of computer simulation, and in particular relates to a framework and method for autonomous air combat decision-making of an unmanned aerial vehicle. Background technique [0002] With the large number of applications of UAVs in the military field, how to establish a high-performance UAV autonomous decision-making method framework has become the key to promoting the deployment of UAVs to further undertake complex tasks and improve application efficiency. The UAV autonomous air combat decision-making method decides its own maneuver or tactical action according to its own mission deployment, threat situation and load configuration, so as to achieve the goal of completing combat missions at the minimum cost. [0003] The decision-making technology based on domain knowledge is the main traditional way to realize autonomous air combat decision-making, and it has the practical characteristics of being easy to construct. How...

AI Technical Summary

Problems solved by technology

However, the main problem of the knowledge decision-making system is that it is difficult to continuously acquire new knowledge and continuously improve the quality of decision-making in the face of a rapidly changing task environment.

Images