Underwater acoustic cooperative communication routing method based on reinforcement learning Sarsa algorithm

Abstract

The invention discloses an underwater acoustic cooperative communication routing method based on a reinforcement learning Sarsa algorithm, and relates to an underwater acoustic network. The method comprises the steps: considering two aspects of reducing underwater acoustic data transmission energy consumption and complexity of a route selection algorithm, and providing route selection for an underwater acoustic multi-hop cooperative communication network by utilizing a reinforcement learning Sarsa algorithm according to an underwater acoustic communication energy consumption model; under the complex condition that a relay node and a cooperative node exist at the same time, rapidly carrying out the underwater acoustic multi-hop cooperative communication network route selection under the condition that the marine environment dynamically changes. A reinforcement learning algorithm is combined with cooperative communication, the operation complexity can be effectively reduced, the route selection stability is enhanced, and the transmission efficiency is improved, so that a cooperative route line enabling the total energy consumption of system transmission to be lowest is obtained, theenergy consumption of an underwater acoustic data transmission system is effectively reduced, and the life cycle of an underwater acoustic communication network is prolonged.

Description

technical field [0001] The invention relates to an underwater acoustic network, in particular to an underwater acoustic cooperative communication routing method based on a reinforcement learning Sarsa algorithm. Background technique [0002] The earth is a "water sphere" composed of 71% water and 29% land. The origin of organisms is inseparable from the ocean. People have always been curious about the mysterious and vast ocean. From ancient times to the present, countless scientific researchers have focused on exploring this mysterious world, and the underwater acoustic communication network is an indispensable technical support in the process of exploring the ocean. At the same time, the development of underwater acoustic communication technology also plays an important role in the development of marine resources and maritime military power. [0003] Due to the constraints of the complex marine environment, the realization of underwater communication is more difficult than...

AI Technical Summary

Problems solved by technology

In the underwater acoustic communication network, most of the current research is on the algorithm optimization in the non-cooperative node network, such as the depth-based routing protocol DBR and the vector-based routing protocol VBF. The application of intelligent algorithms in underwater acoustic communication networks, but there is no research on applying the reinforcement learning Sarsa algorithm to the routing selection of underwater acoustic multi-hop cooperative communication networks

Images