Underwater acoustic communication adaptive modulation coding algorithm based on reinforcement learning

Abstract

The invention belongs to the field of underwater acoustic communication, and discloses an underwater acoustic communication adaptive modulation coding algorithm based on reinforcement learning, which autonomously explores the relationship between channel quality and a modulation coding scheme through a reinforcement learning algorithm, and establishes a reliable MCS switching threshold. The method comprises the following steps: firstly, defining a modulation and coding scheme, a signal-to-noise ratio and throughput as three elements state, action and reward of a Q table, initializing the Q table and an initial moment, randomly selecting the modulation and coding scheme to send a signal, receiving a demodulation signal and sending a feedback signal by a receiving end, updating the Q table by a reinforcement learning module according to the feedback information and selecting the modulation and coding scheme to send the signal according to the new Q table, and a receiving end receives the demodulation signal and sends a feedback signal, the above steps are repeated, and an accurate MCS switching threshold is obtained after multiple times of learning by a reinforcement learning module. The problem that a certain error exists in the MCS switching threshold obtained by giving a mathematical model according to simulation or a certain assumption in the traditional adaptive modulation coding technology is solved.

Description

technical field [0001] The invention belongs to the technical field of underwater acoustic communication, and relates to a communication system combining a reinforcement learning algorithm and an adaptive modulation and coding technology. Background technique [0002] Underwater acoustic communication is the most mature communication method in underwater communication, but the underwater acoustic channel has the characteristics of time-varying, space-varying, and frequency-varying. Noise in the ocean, attenuation during signal propagation, multipath propagation, and Doppler frequency These factors directly affect the reliability of underwater acoustic communication. Using channel coding technology to process the information to be sent can effectively resist the interference in the underwater acoustic channel, reduce the bit error rate, and improve the reliability of underwater acoustic communication. As the underwater environment changes all the time, the underwater acousti...

AI Technical Summary

Problems solved by technology

[0004] In view of the fact that the traditional adaptive modulation and coding algorithm in the underwater acoustic communication system is difficult to meet the frame error rate requirements for complex and changeable underwater acoustic channels, the present invention proposes an adaptive modulation and coding algorithm based on reinforcement learning to solve the above problems

Images