Network Adaptive Routing Method and System for Unmanned Systems Based on Deep Reinforcement Learning

Abstract

The present invention proposes an adaptive routing method for unmanned system networks based on deep reinforcement learning, aiming to solve the technical problems in the prior art that the high-speed movement of nodes and the frequently changing network topology cannot provide adaptive routing strategies. The method includes: all nodes send HELLO information packets at an adaptive time interval; after any node receives the HELLO information packets sent by its neighbor nodes, update the node information of the neighbor node in the neighbor table of the node; Routing strategy algorithm framework of deep reinforcement learning; design of routing strategy implementation method based on deep reinforcement learning. The invention has good model generalization ability, and can be generalized on networks with different network scales and different node moving speeds, so that the invention is more suitable for unmanned system networks with dynamic changes.

Description

technical field [0001] The invention relates to an unmanned system network adaptive routing method based on deep reinforcement learning, which belongs to the field of information technology. Background technique [0002] An unmanned system (Unmanned System) is composed of a number of necessary data processing units, sensors, automatic control units, and communication systems. It is a machine or device that can complete specific tasks autonomously without human intervention. These unmanned machines or devices can be unmanned. drones, unmanned vehicles, ground robots, underwater robots, surface robots and satellites. [0003] An unmanned system network is a network established by unmanned systems in the form of self-organization or based on network infrastructure. Among them, the unmanned system network established in the form of self-organization can give full play to the perception ability and strong computing power of the unmanned system, and can effectively adapt to netwo...

AI Technical Summary

Problems solved by technology

[0006] Aiming at the deficiencies of the prior art, the purpose of the present invention is to propose a method and system for self-adaptive routing of the unmanned system network based on deep reinforcement learning, so as to solve the problems caused by the high-speed movement of nodes and the wireless link in the mobile unmanned system network in the prior art. Due to the influence of unstable roads and frequent changes in the network topology of mobile robots, it is impossible to provide adaptive and reliable routing decisions.

Images