Frequency-power united allocation method based on multi-agent reinforcement learning in dynamic frequency spectrum environment

Abstract

The invention relates to a frequency-power united allocation method based on multi-agent reinforcement learning in a dynamic frequency spectrum environment. A time slot structure for realizing the frequency-power united allocation in the dynamic frequency spectrum environment comprises three time slots: a perception decision time slot, a transmission time slot and a confirmation time slot, wherein the perception decision time slot is used for realizing the perception of a main user state and acquiring a frequency-power united decision of the transmission time slot; the transmission time slot is used for realizing information transmission, estimating a link gain at a receiving end, calculating a current return value and metering the size of interference; and the confirmation time slot is used for receiving ACK (Acknowledgement Character) signals, the link gain, the current return value and feedback information of the size of the interference, and updating a behavior return function needed by the multi-agent reinforcement learning, a historical interference table and estimated values of frequency policies of other cognitive links. According to the method provided by the invention, the real-time frequency-power united allocation with excellent performance can be realized in the dynamic frequency spectrum environment.

Description

technical field [0001] The invention relates to the field of cognitive radio in the wireless communication technology, in particular to a new method for realizing joint allocation of frequency power in a dynamic spectrum environment based on multi-agent reinforcement learning. Background technique [0002] At present, with the rapid growth of types of wireless communication services, the demand for wireless spectrum resources is also increasing exponentially, making the problem of "lack" of spectrum resources in future wireless communications increasingly prominent. Cognitive radio technology utilizes the idle frequency band of licensed users in the way of "opportunistic access" under the condition of ensuring the quality of service of primary users, which greatly improves the efficiency of spectrum use and is an effective method to solve the problem of "spectrum scarcity". The frequency and power joint allocation technology in cognitive radio networks (CRN for short) reduce...

AI Technical Summary

Problems solved by technology

However, when multiple SUs coexist, the performance of the RL learning method will be greatly reduced, or even unable to converge, because the frequency and power coupling decisions of each SU affect each other, restrict each other, and are in dynamic changes.

Images