Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

192 results about "Air combat" patented technology

Unmanned aerial vehicle cooperative air combat decision-making method based on GRU-MAPPO deep reinforcement learning

The invention discloses an unmanned aerial vehicle cooperative air combat decision-making method based on GRU-MAPPO deep reinforcement learning, and relates to an air combat game maneuvering strategy. The method comprises the following steps: starting from a complex air combat environment, analyzing a motion model, a maneuvering action, an air combat situation and a reward function of an unmanned aerial vehicle, and establishing a multi-unmanned aerial vehicle air combat environment model which comprises an unmanned aerial vehicle particle motion model, an unmanned aerial vehicle maneuvering action model, an air combat situation evaluation model and an unmanned aerial vehicle reward function model; for a completely cooperative multi-agent environment, a partially observable Markov decision chain framework is established, and a working mode of centralized training and distributed execution is adopted; for unmanned aerial vehicle collaborative decision making, a near-end strategy optimization PPO algorithm is expanded to the multi-agent field, and a GRU is used to replace a full-connection neural network in an original algorithm, so that a GRU-MAPPO algorithm suitable for multi-agent deep reinforcement learning is obtained; a simulation experiment shows that the method can improve the collaborative decision-making capability and the air combat winning rate of the unmanned aerial vehicle.
Owner:XIAMEN UNIV

System for recognizing aircraft maneuvers on basis of deep learning

PCT designated stage expiredWO2025118934A1Neural learning methodsFlight vehicleSimulation
The present invention relates to the field of machine learning, and relates to a system for recognizing aircraft maneuvers on the basis of deep learning. The system is aimed at tasks of understanding tactical actions in air combat games, and performs operations of detection, recognition, analysis, etc., for independent and continuous maneuvering actions of an aircraft. The recognition and analysis system comprises a data collection module, a data pre-processing module, a data normalization module, a model training module, a model prediction module, and a result visualization module. Aircraft maneuver trajectory data is collected by means of an aircraft maneuver trajectory collection apparatus in a sample data collection module, and then the collected aircraft maneuver trajectory data is preprocessed in the data preprocessing module and the data normalization module, so that the aircraft maneuver trajectory data meets requirements during model training and prediction. For new continuous-maneuver samples, each independent maneuver in the samples and corresponding start and end time are predicted by using a continuous-maneuver recognition model which is obtained by means of training; and finally, the result visualization module generates recognition visualization results of predicted maneuver samples.
Owner:CHENGDU AIRCRAFT DESIGN INST OF AVIATION IND CORP OF CHINA

Air real-time combat management system based on hybrid intelligence

The invention belongs to the field of combat management, and particularly relates to an air real-time combat management system based on hybrid intelligence, which is characterized in that a cross-domain thermodynamic perception situation map and a cross-domain fusion situation map are generated through sensing module multi-modal target data through situation fusion, threat analysis and target sorting; the hierarchical autonomous decision-making module analyzes combat requirements by using an enhanced hierarchical and hierarchical subsystem, constructs and generates a sub-target sequence and an interactive network through target decomposition and a constraint node network, and generates an optimal tactical control instruction set in combination with resource prediction allocation and tactical evaluation; the cross-layer intervention module dynamically adjusts an autonomous decision permission weight and an instruction according to a task risk, a communication state and a decision score, and realizes the control right of a person in a decision ring by using the instruction of a commander as the highest intervention decision instruction of each layer; the analogue simulation module integrates the subsystems and the man-machine constraint boundary, and performs collaborative decision simulation until the standard is reached; and integrated management of real-time sensing of the air combat situation, intelligent hierarchical decision under dynamic constraint, man-machine permission flexible adjustment and collaborative simulation verification is realized.
Owner:ARK SUNAC (BEIJING) TECHNOLOGY CO LTD

Missile avoidance and rotary enemy locking maneuvering strategy generation method

The invention discloses a missile avoidance and rotary enemy locking maneuvering strategy generation method, which comprises the following steps: S1, establishing a kinematics model and a dynamics model of an airplane and a missile based on Newton's law of motion, and simulating flight tracks and states of the airplane and the missile; s2, based on the kinematics model and the dynamics model, establishing a 1v1 beyond-visual-range air combat environment; s3, designing a state space, an action space and a reward function of deep reinforcement learning for the quadruple of deep reinforcement learning, and integrating the three into an over-the-horizon air combat environment to complete the design of a state transfer function; s4, simulating a warplane by using an intelligent agent, and performing repeated simulation confrontation by using the deep reinforcement learning framework to optimize and adjust a strategy and improve the survivability and combat efficiency in an air combat; and through continuous iterative training of the reinforcement learning model, the intelligent agent autonomously learns an effective maneuvering strategy so as to cope with threats of enemy planes and missiles from different directions.
Owner:FUDAN UNIVERSITY

Multi-unmanned aerial vehicle air combat advantage competition strategy generation method based on graph attention network

The invention discloses a multi-unmanned aerial vehicle air combat advantage competition strategy generation method based on a graph attention network. The method comprises the following steps: a, representing air combat observation data as a topological graph; b, according to the topological graph, adopting a graph attention neural network as a strategy model, and combining priori knowledge to obtain an abstract relation graph representing an air combat relation; and c, carrying out maneuvering decision making according to the abstract relation graph. According to the invention, a graph attention network and a method for establishing an abstract relation graph are adopted to learn a strategy which is more beneficial to cooperation; and the air combat relationship and communication among the unmanned aerial vehicles are enhanced, so that the finally output actions achieve effective cooperation.
Owner:UNIV OF ELECTRONICS SCI & TECH OF CHINA

Air battle intelligent decision-making method, device and equipment based on course reinforcement learning and medium

The invention provides an air battle intelligent decision-making method and device based on course reinforcement learning, equipment and a medium, and relates to the field of reinforcement learning. Comprising the steps of determining corresponding combat advantage indexes based on multiple groups of initial state data; sorting the initial state data based on a combat advantage index, and storing the sorted initial state data into a difficulty-guided state pool; updating the initial state data in the progressive sliding buffer area from the difficulty-guided state pool according to a difficulty increasing mode; dynamically formulating an intermediate task target until a final task target is formulated; sampling current initial state data from the progressive sliding buffer area, and inputting the current initial state data into a strategy network of the SAC model to obtain a current action; and the SAC model is trained at least based on the intermediate task target, the current action and the current initial state data until the final task target is reached, and the trained SAC model is obtained for making an intelligent decision, so that the decision-making ability and the adaptive ability of the aircraft in a complex environment are improved.
Owner:SICHUAN UNIV

Unmanned aerial vehicle air combat confrontation method based on hierarchical reinforcement learning

The invention provides an unmanned aerial vehicle air combat confrontation method based on hierarchical reinforcement learning, and belongs to the technical field of unmanned aerial vehicle control. According to the invention, the technical problem of improving the autonomous decision-making and control capability of the unmanned aerial vehicle in a complex air combat environment is solved. According to the technical scheme, the method comprises the following steps: S1, situation acquisition; s2, layered action space design; s3, training a layered reward function and a strategy; and S4, performing model deployment and real-time optimization. The method has the beneficial effects that a complex problem is decomposed into a plurality of sub-problems, and learning and decision making are carried out on different levels, so that the complexity can be better handled, the autonomy and adaptability of the unmanned aerial vehicle are improved, and the development of an unmanned aerial vehicle control technology is promoted; and the autonomous decision-making and control capability of the unmanned aerial vehicle in a complex air combat environment is obviously improved.
Owner:NANTONG UNIV

Air combat intelligent decision-making method and system combining imitation learning and reinforcement learning

The invention discloses an air combat intelligent decision-making method combining imitation learning and reinforcement learning, and belongs to the field of air combat, and the method comprises the steps: processing battlefield situation information through an air combat intelligent decision-making model, and obtaining a decision-making result used for guiding a local machine. The pre-trained air combat intelligent decision-making model is obtained through the following steps: for sparse expert strategy data with coarse granularity, using a behavior cloning algorithm to train a neural network architecture for imitation learning and reinforcement learning to obtain a strategy network Q1; taking the strategy network Q1 as an initial network in a generative adversarial imitation learning algorithm, and performing imitation learning on a fine-granularity dense expert strategy to obtain a strategy network Q2; and taking the strategy network Q2 as an initial network of a decision network in the reinforcement learning algorithm framework, and carrying out network training by adopting a strategy gradient method until convergence to obtain an air combat intelligent decision model. According to the invention, the sample utilization rate can be effectively improved, and accumulative errors are reduced.
Owner:FUDAN UNIVERSITY

Multi-unmanned aerial vehicle cooperative confrontation decision-making method and system

The invention relates to a multi-unmanned aerial vehicle cooperative confrontation decision-making method and system. The method comprises the following steps: constructing a multi-unmanned aerial vehicle cooperative air combat confrontation decision-making environment by establishing a multi-unmanned aerial vehicle air combat confrontation motion model and an air combat situation evaluation model; establishing a distributed partially observable Markov decision process model of the multi-unmanned aerial vehicle cooperative confrontation decision problem according to the action space and the local observation and state of each unmanned aerial vehicle in the confrontation decision environment; designing a multi-machine collaborative adversarial reward function and an HASAC algorithm network space; and training and generating a multi-unmanned-aerial-vehicle cooperative confrontation strategy model based on interaction between a network space and a multi-unmanned-aerial-vehicle cooperative confrontation decision-making environment of an HASAC algorithm. According to the method, for the multi-aircraft cooperative air combat confrontation problem, the specific global state is designed for the multi-aircraft cooperative confrontation decision-making unmanned aerial vehicle, and compared with direct splicing of observation vectors of all unmanned aerial vehicles, the global state dimension is reduced, and the training efficiency is improved.
Owner:BEIHANG UNIV

BiLSTM + Attention three-layer air combat target intention prediction method of multi-feature continuous time sequence

The invention discloses a BiLSTM + Attention three-layer air combat target intention prediction method of a multi-feature continuous time sequence. The method comprises the following steps: 1, establishing an air combat intention prediction basic data set; 2, performing threat assessment on the air combat intention basic data set to obtain an air combat intention threat data set; 3, constructing a BiLSTM + Attention network model, and inputting the air combat intention threat data set for training; and 4, performing tactical intention prediction on subsequent time series data based on trajectory prediction, threat evaluation and the trained BiLSTM + Attention network model. The method is simple in steps and reasonable in design, intention prediction is carried out by combining forward air combat feature data at multiple continuous moments, backward target aircraft air combat trajectory prediction data and battlefield threat assessment, and the reliability of air combat target intention prediction is improved.
Owner:AIR FORCE UNIV PLA

Deep reinforcement learning air combat decision-making method based on situation prediction

The invention provides a deep reinforcement learning air combat decision-making method based on situation prediction, belongs to the technical field, and solves the technical problem that an unmanned aerial vehicle cannot realize autonomous decision-making and environment self-adaption in a complex air combat environment. According to the technical scheme, modeling is carried out through kinematics and dynamics characteristics of the unmanned aerial vehicle to adapt to the actual flight state; establishing a deep enhanced confrontation environment for unmanned aerial vehicle confrontation training; dynamically evaluating the state of the enemy unmanned aerial vehicle by using an LSTM prediction algorithm, and quickly obtaining the state of the enemy unmanned aerial vehicle at the next moment; and taking reward distribution as input of a decision maker, and inferring enemy unmanned aerial vehicle situation actions in combination with a prediction state and a reward result to realize tracking strike. According to the method, the advantage of machine intelligent calculation and human experience judgment are combined, the intention recognition accuracy of the enemy unmanned aerial vehicle is improved in a complex and uncertain environment, and the decision-making ability and tactical advantages of our unmanned aerial vehicle are enhanced.
Owner:NANTONG UNIV

Unsupervised unmanned aerial vehicle air combat situation assessment method based on double attention mechanisms and BiGRU

The invention discloses an unsupervised unmanned aerial vehicle air combat situation assessment method based on a double attention mechanism and a BiGRU, and belongs to the technical field of crossing of machine learning and modern military. The method comprises the following steps: firstly, designing a clustering method, providing a parameter adaptive density grid clustering method based on a fuzzy theory to process a large-scale target, and establishing an air combat information sample set with time and tactical meanings to facilitate subsequent rapid evaluation; on the basis, an encoder-decoder structure taking BiGRU as a trunk is designed to extract depth information of a historical state and a subsequent flight state of a target in two directions, and a double attention mechanism suitable for time sequence data is improved, so that the model can better pay attention to key parts and key features of an input sequence. According to the method, the generalization ability and the practical application value of an air combat situation evaluation model can be improved, the processing ability and the evaluation precision of situation data are improved, the influence of irrelevant parts in high-dimensional and long-sequence time data on an evaluation result is reduced, and the modern air combat requirement is met.
Owner:DALIAN UNIV OF TECH

Air combat strategy generation system and method based on lightweight sequence modeling imitation learning

The invention provides an air combat strategy generation method based on lightweight sequence modeling imitation learning. According to the training method, an air combat decision model based on rules can be quickly migrated into a parameter model in a neural network form. The method comprises the following steps: firstly, constructing a rule-based air combat decision model, and generating high-quality training data through adversarial simulation; and then, the training data is converted into a state-action sequence pair, and the state-action sequence pair is input into a lightweight sequence modeling network based on a Transform architecture for learning and training. According to the method, decision knowledge of a rule model is converted into a neural network model through an imitation learning method, and efficient utilization and flexible generalization of expert knowledge in air combat decision model construction are realized; the model designed by the method can accurately reproduce the decision behavior of the rule model through a small amount of training, and compared with a reinforcement learning method, the strategy construction speed is higher and the strategy performance is more stable.
Owner:BEIHANG UNIV

Improved unmanned aerial vehicle path planning method based on deep reinforcement learning

The invention relates to the technical field of unmanned aerial vehicle control, in particular to an unmanned aerial vehicle path planning method based on deep reinforcement learning. The method comprises the following steps: constructing an unmanned aerial vehicle-missile confrontation environment model for providing reward calculation, termination judgment and a visual interface so as to provide training data and evaluate the path planning performance of a reinforcement learning strategy; an Actor-Critic deep neural network model based on strategy gradient is constructed, the unmanned aerial vehicle state information is taken as input, the maneuvering acceleration is taken as output, and adaptive learning of the unmanned aerial vehicle maneuvering strategy is realized; in the reinforcement learning process, mechanisms such as dominant function normalization, generalized dominant estimation and gradient cutting are introduced, and the training stability and convergence speed are improved; by adopting a layered reward mechanism and an improved PPO algorithm, the method effectively solves the problems of difficulty in training convergence, poor strategy stability and low energy utilization rate of a traditional deep reinforcement learning method in a complex air combat environment, realizes autonomous decision making and optimal avoidance path planning of the unmanned aerial vehicle under a high confrontation condition, and improves the unmanned aerial vehicle experience. And the avoidance success rate and the training efficiency are obviously improved.
Owner:UNIV OF SCI & TECH BEIJING

Fighter flight control method based on adversarial skill embedding and hierarchical reinforcement learning

The present invention discloses a fighter flight control method based on adversarial skill embedding and hierarchical reinforcement learning. The method designs an adversarial skill embedding learning framework composed of an adversarial generative algorithm and a deep reinforcement learning algorithm. The method uses expert flight data to automatically learn the mapping of underlying control instructions to macro maneuvering skills by an AI algorithm. By reusing these macro maneuvering skills, the method significantly reduces the learning difficulty of downstream air combat tasks, greatly compresses the convergence time of the reinforcement learning algorithm, improves the game performance of air combat intelligent agents, and gives air combat intelligent agents higher flexibility and rapid migration capabilities, thereby exploring a new technical path for the practical training and deployment of air combat intelligent agents.
Owner:ZHEJIANG LAB

Distributed joint simulation platform based on air-to-air combat scene

The invention relates to the technical field of air-to-air combat, and discloses a distributed joint simulation platform based on an air-to-air combat scene, which comprises a simulation resource management module, a model component storage module, a combat platform creation module, a simulation scene creation module, a simulation military strength planning module and a simulation driving engine module. In the simulation model integration stage, the simulation resource management module is mainly used for uniformly integrating, registering and managing the software information of each module, and meanwhile, the simulation scene creation module is used for editing and managing the software information of each module. In the simulation preparation stage, combat wanting performance needs to be matched through a simulation military strength planning module. In the simulation operation stage, the simulation driving engine module drives the whole simulation scene, and therefore simulation deduction of the combat scene is achieved. Through a distributed simulation technology, air-air combat simulation resource requirements in a large space-time range are matched, and the integration, driving, crosslinking and management problems of a digital simulation environment on each model are solved.
Owner:SHENYANG AIRCRAFT DESIGN INST AVIATION IND CORP OF CHINA +1

Aircraft cluster multi-task scheduling system based on cooperative game and working method thereof

The invention discloses an aircraft cluster multi-task scheduling system based on a cooperative game and a working method thereof. The system comprises a simulation environment module, a hierarchical strategy network module, a centralized value network module and a training and execution module. The simulation environment module is used for constructing a multi-agent air combat confrontation environment and generating states, rewards and interaction data required by training; the hierarchical strategy network comprises a shared space-time representation encoder f theta (.), a high-layer strategy network pi H (aHz) and a low-layer strategy network pi L (aLz; aH); the centralized value network is used for receiving global state information in a training stage, estimating the overall return of our agent cluster, calculating a dominant function, and realizing the optimization of the network by minimizing the value loss; and the training and execution module optimizes a centralized value network parameter and hierarchical strategy network parameters theta H and theta L by using a global state St in a centralized training stage, and outputs an air combat decision ai according to local observation independent decisions of each agent in a distributed execution stage.
Owner:HEBEI UNIV OF TECH

Multi-agent air combat cooperative control method and device based on state machine-large model

The invention belongs to the technical field of unmanned fighter fighting, and provides a multi-agent air combat cooperative control method and device based on a state machine-large model. The system comprises an air confrontation environment, an unmanned fighter plane intelligent body, an action finite-state machine, a team tactical state machine and a language large model decision module. The behavior of the unmanned fighter is cooperatively controlled by an action state machine (including take-off, combat and servicing states) and a team tactics state machine (including no tactics, fire concentration, surrounding and cross support), and the team tactics is taken as the criterion during conflict. The large language model is used for reasoning the overall tactics before the battle and predicting the tactical state of the enemy. And in a non-Nash equilibrium state, the system can be traced back to a key node to reset tactics and repeatedly deduce until optimal cooperation is achieved. According to the method, the autonomous decision robustness and tactical cooperation efficiency of the unmanned aerial vehicle cluster in the denial airspace are improved, and a new paradigm of air combat intelligent control is constructed. The invention discloses a multi-agent air combat cooperative control method and device based on a state machine-large model.
Owner:UNIV OF SCI & TECH BEIJING

Air combat combat strategy training method based on PPO algorithm and Transform-XL framework

The invention discloses an air combat combat strategy training method based on a PPO algorithm and a Transform-XL framework, and the method comprises the steps: enabling an intelligent agent to have more advantages in the processing of long-time sequence data through the segmentation memory and the modeling of a long-range dependency relationship in the Gated Transform-XL framework, and improving the capturing capability of the intelligent agent for the long-time dependency relationship; the intelligent agent can better adapt to the dynamically changing battlefield environment, and the applicability and robustness of the strategy are improved.
Owner:BEIJING INST OF TECH

Air combat decision-making method and system based on generative adversarial imitation learning

The invention discloses an air combat decision-making method and system based on generative adversarial imitation learning, and belongs to the technical field of aviation, and the method comprises the steps: obtaining battlefield situation information, carrying out the processing of the battlefield situation information through a pre-trained air combat decision-making model, and obtaining a decision-making result used for guiding a local machine. The air combat decision model is obtained through the following steps of obtaining typical combat opponent data, performing enhancement processing on the typical combat opponent data, and obtaining a red-blue confrontation data set; and training based on the red-blue adversarial data set by utilizing a generative adversarial imitation learning algorithm to obtain an air combat decision model. According to the method, through algorithm design, the problem of modal collapse in the generative adversarial imitation learning training process is solved, and diversity and generalization of generated strategies can be ensured; the problem of low sample utilization efficiency is solved through the data enhancement method, and a better training result can be obtained based on less sample training; and the method still has decision robustness in a complex dynamic environment.
Owner:FUDAN UNIVERSITY

Multi-machine air combat cooperation method based on hierarchical deep reinforcement learning

The invention discloses a multi-aircraft air combat cooperation method, system and device based on hierarchical deep reinforcement learning, a storage medium, equipment and a computer program product. The method comprises the following steps: acquiring environment perception information and external action decision information sent from an external aircraft; inputting the environment perception information and the external action decision information into a tactical decision network to obtain flight state expectation information of a local aircraft; and inputting the state expectation information and the environment perception information into a control decision network to obtain local action decision information of the local aircraft. The external action information is introduced to enhance the observation content, a hierarchical network structure is adopted to improve the abstract ability of the decision, and closed-loop control from strategy to execution is realized through upper and lower layer collaboration, so that role allocation among aircrafts is more accurate, the collaboration behavior is more efficient, the task completion effect in the multi-aircraft collaboration air combat is improved, and the system performance is improved. And risks of combat faults and resource waste are reduced.
Owner:SICHUAN UNIV

Large-view-field binocular image combination dynamic parameter adjusting system

The invention relates to the field of optical imaging and computer vision, discloses a large-view-field binocular image combination dynamic parameter adjusting system, and aims to solve the problems that a traditional head-up display is limited in view field and monochromatic display and information response are lagged. The system comprises a left and right eye image acquisition and preprocessing unit, a target positioning and trajectory prediction unit, a binocular parallax compensation and registration unit, a dynamic fusion display control unit, a color enhancement and information superposition unit, an eye movement tracking feedback unit and a parameter adaptive adjustment unit. Through binocular wide-angle acquisition, three-dimensional target prediction, sub-pixel-level image registration, panoramic stitching fusion, semantic color coding and dynamic parameter adjustment of eye movement driving, 120-degree * 60-degree distortionless panoramic display, multi-source information intelligent layered superposition and visual focus area adaptive enhancement are realized. According to the method, the air combat situation sensing efficiency and the weapon response speed are improved, and the method has high real-time performance (delay of lt, 80ms), strong environmental adaptability and engineering integration.
Owner:SUZHOU LIPAI TECH CO LTD

Decision-to-behavior issuing method in air combat process based on large language model

The invention relates to the field of intelligent decision-making of a big language model, in particular to a decision-to-behavior issuing method in an air combat process based on a big language model, which comprises the following steps: S1, collecting data for fine tuning: data sources comprise actual combat flight logs, simulation experiment data and expert rule data; s2, classifying and processing data for fine tuning: classifying and processing the original data collected in the step S1 to form a data format required by fine tuning of the large language model; s3, fine tuning of the large language model: selecting a proper large language model and a fine tuning tool, and performing fine tuning by using fine tuning data; and S4, issuing a decision to a large language model: for the situation information and a decision instruction, giving unmanned aerial vehicle control behaviors and parameters by the large language model. According to the method, the whole process from decision making to behavior issuing in the air combat process is intelligently upgraded by utilizing the powerful reasoning ability and high operability of the large language model (LLM), and the method has the advantages of low operation threshold and high applicability.
Owner:BEIHANG UNIV

Air combat decision-making method based on position weight speed updating particle swarm algorithm

The invention provides an air combat decision-making method based on a position weight speed updating particle swarm algorithm, which comprises the following steps of: firstly, performing problem simplification on a complex air combat scene, establishing a success rate model of our-party and enemy aircraft attack and coping, and establishing and analyzing an index system in the air combat scene by adopting an analytic hierarchy process; the method comprises the following steps: firstly, obtaining an aircraft attack success influence factor and a corresponding weight, then obtaining a simplified objective function in combination with a multi-objective optimization model and a linear weighting method, and finally, introducing position weight information and an optimization speed updating strategy on the basis of a traditional PSO algorithm, and proposing a PW-PSO algorithm. And the air combat decision is solved based on the improved particle swarm optimization (PW-PSO). Through the scheme of the invention, the convergence speed of the algorithm can be effectively improved, the decision-making efficiency is improved, more accurate attack to enemy targets and effective avoidance of own damage are realized, and the reliability and the real-time performance of air combat decision making are remarkably improved.
Owner:UNIV OF ELECTRONICS SCI & TECH OF CHINA

Aircraft missile avoidance decision-making method based on LSTM and PPO

The invention relates to an aircraft missile avoidance decision-making method based on LSTM and PPO, and the method comprises the following steps: 1, collecting data, and 2, carrying out the normalization processing and feature fusion of the observation information of an aircraft and a missile through a long and short term memory network according to the data collected in simulation, and building the time sequence features of the aircraft and the missile. And step 3, establishing a hierarchical model based on a depth deterministic strategy algorithm in deep reinforcement learning, and controlling the rod amount to realize specific flight control. 4, respectively establishing communication between the client side and the server side according to the defined model, and 5, repeating the steps 1-4 until a PPO algorithm training ending condition is reached, and terminating the training. According to the scheme, the flexibility and the real-time performance of decision making are improved, the dependence on traditional modeling and expert knowledge is reduced, and a more intelligent solution is provided for modern air war.
Owner:POLIXIR TECH LTD

Hierarchical decision-making air combat confrontation system and method based on attack area game

The invention provides a hierarchical decision-making air combat confrontation system and method based on attack area game, and the system comprises a top-layer tactical design module which guides a first-party aircraft in two air combat confrontation parties to adopt a strategy according to a set tactical, and obtains an event triggering type finite-state machine; the high-level state switching module carries out state switching according to the event triggering type finite-state machine according to the occurred event, and updates the state of the first-party aircraft; the middle-layer situation assessment module obtains the state and observation information of a first-party aircraft from a simulation environment or a real environment, measures the relative advantages between the aircrafts of the two confrontation parties, obtains situation assessment results of the two confrontation parties, and carries out target allocation; and the underlying attack area game module takes the situation assessment results of the two confrontation parties as input according to the target distribution result, and completes the output of the optimal confrontation strategy of the first party through the analysis game of the relative situation. The method can achieve the confrontation game in a complex air combat scene, is high in decision-making efficiency, is high in interpretability, and is high in confrontation winning rate.
Owner:SHANGHAI JIAOTONG UNIV

Unmanned aerial vehicle air fighter action decision-making method based on near-end strategy optimization and gating circulation unit

The invention relates to the technical field of artificial intelligence, and provides an unmanned aerial vehicle air combat aircraft action decision-making method based on near-end strategy optimization and a gating circulation unit, and the method comprises the steps: constructing a three-dimensional unmanned aerial vehicle air combat simulation environment; an Actor-Critic neural network architecture based on a GRU is constructed, and iterative training is performed on the neural network through a large amount of self-adversarial and learning. According to the scheme provided by the invention, the time sequence feature perception capability is enhanced, and the intelligent agent can better capture and understand the time sequence dependency relationship of the flight state in the air combat environment by introducing the GRU network, such as inferring the target intention or predicting the future situation from the continuous state change, so that a more prospective decision is made. And the method adapts to a complex dynamic environment, wherein the unmanned aerial vehicle air combat environment has high dynamic and uncertainty. According to the method, the unmanned aerial vehicle can gradually adapt to the complex environment and learn an effective confrontation strategy through an online interaction and learning mechanism of reinforcement learning and the processing capability of the GRU on the dynamic sequence.
Owner:SHENYANG AEROSPACE UNIVERSITY

A Distributed MIMO Radar Resource Allocation Method for Integrated Reconnaissance, Interference and Communication

This invention discloses a distributed MIMO radar resource allocation method for integrated reconnaissance, interception, and communication, belonging to the technical field of radar resource allocation. It aims to solve the performance balance problem under multi-task coordination in distributed MIMO radar air combat scenarios. An integrated reconnaissance, interception, and communication adversarial scenario is constructed, using the lower bound of position estimation error (SPEB), missile detection probability, and inter-node communication capacity as performance evaluation indicators for reconnaissance, interception, and communication, respectively. Then, with the goal of minimizing the total system transmit power, a model is constructed by combining relevant performance constraints and node task rules. Finally, the model is transformed into a mixed-integer second-order cone programming problem, and the non-convex terms are convexified using the McCormick envelope method. A numerical solution is obtained based on the CVX solver in MATLAB, achieving joint optimization of node task allocation and power allocation. This invention reduces the total transmit power while satisfying three types of performance requirements, achieving efficient waveform resource scheduling and improving the practicality and robustness of radar countermeasures.
Owner:HUAIBEI NORMAL UNIVERSITY

Load balancing-oriented airborne missile group multipath reliable routing method

PendingCN120282233ATransmissionWireless communicationQuality of serviceProtocol overhead
The invention discloses a load balancing-oriented airborne missile group multipath reliable routing method, which belongs to the technical field of air combat platform group network communication, and comprises multipath routing generation and multipath routing service forwarding of a QoS (Quality of Service)-based comprehensive state model, the route searching comprises the step of searching a first route between a given source node and a target node pair through an OLSR (Open Link Scheduling Route) protocol; all links on the known route are eliminated, and route searching is carried out again; and eliminating the link with the maximum load on the known route, and searching the route again. According to the airborne missile group multipath reliable routing method oriented to load balancing, multipath routing is realized by properly increasing protocol overhead, so that network load balancing is realized. Meanwhile, under the condition of enemy interference, a multi-path routing mode is adopted to replace an interfered link, and reliable transmission of core information of the backbone node is ensured.
Owner:BEIJING INST OF TECH

A method and system for intelligent decision-making in air combat that combines imitation learning and reinforcement learning

This invention discloses an intelligent air combat decision-making method combining imitation learning and reinforcement learning, belonging to the field of air combat. The method includes: processing battlefield situation information through an intelligent air combat decision-making model to obtain decision results for guiding the aircraft. The pre-trained intelligent air combat decision-making model is obtained through the following steps: for coarse-grained sparse expert policy data, a behavior cloning algorithm is used to train a neural network architecture for imitation learning and reinforcement learning to obtain a policy network Q1; the policy network Q1 is used as the initial network in a generative adversarial imitation learning algorithm to perform imitation learning on fine-grained dense expert policies to obtain a policy network Q2; the policy network Q2 is used as the initial network in a reinforcement learning algorithm framework for decision network training, and the policy gradient method is used to train the network until convergence to obtain the intelligent air combat decision-making model. This invention is based on the ability to effectively improve sample utilization and reduce cumulative error.
Owner:FUDAN UNIVERSITY