A hierarchical reinforcement learning anti-interference algorithm for joint optimization of channel selection and transmission time

Abstract

The invention discloses a hierarchical reinforcement learning anti-interference algorithm for joint optimization of channel selection and transmission time. The algorithm comprises a wireless communication network consisting of a transmitter, a receiver and an interference machine, wherein the interference machine generates an interference signal according to any one of a frequency sweeping mode,a comb mode and a random mode; On a data channel, a transmitter and a receiver carry out data communication in a dynamic spectrum access mode so as to withstand Communication interference to the transmitter / receiver caused by interference signals released by the jammer; And on the control channel, the transmitter and the receiver realize coordination of the dynamic spectrum of the transmitting andreceiving end through information interaction. In a dynamic interference scene, channel selection optimization based on fast reinforcement learning is carried out with a small time granularity, transmission time length optimization based on a random automatic learning machine is carried out with a large time granularity, and loop execution is carried out until the data transmission time length isconverged or reaches the maximum iteration frequency. The throughput of the wireless communication network system is improved.

Description

technical field [0001] The invention belongs to the technical field of wireless communication, in particular to a layered reinforcement learning anti-jamming algorithm for joint optimization of channel selection and transmission time. Background technique [0002] Based on cognitive radio theory, anti-jamming communication by means of dynamic spectrum access is a major research hotspot in the field of anti-jamming. However, in the actual anti-jamming communication process, the length of data transmission time has a non-negligible effect on the throughput of the anti-jamming system. When the transmission time length is much longer than the interference time length, it is easy to suffer from multiple interferences within one data transmission time, which will seriously reduce the quality of communication. Conversely, when the transmission time length is much smaller than the interference time length, it will cause the user to switch working channels frequently, consume more s...

AI Technical Summary

Problems solved by technology

In the above literature, a better solution to the channel selection problem in single-user and multi-user scenarios is proposed, and the performance of the proposed algorithm is verified by simulation, but the actual communication is restricted by factors such as channel and transmission time. In the literature, only the influence of a single factor is considered

[0004] At present, in the field of anti-jamming, the influence of channel selection on anti-jamming performance is mainly studied, and the anti-jamming quality is not considered to be affected by various factors in actual communication. Impact

Images