A2C-based unauthorized spectrum resource sharing method

Abstract

The invention relates to an unlicensed spectrum resource sharing method based on Advanced Actor-Criteric (A2C), and belongs to the technical field of wireless communication. The method comprises the following steps: S1, describing a resource sharing problem in an LTE / WiFi coexistence scene as a cooperative game process, and providing an A2C reinforcement learning algorithm to solve the problem; s2, designing an action set A, a reward function R and a state S of the intelligent agent SBS; s3, an environment is initialized, and each agent SBS obtains an initial state value st; s4, each agent SBS inputs the current state st into an Actor network of the agent SBS, and independently selects and executes an action at; s5, after the action at is executed, the agent SBS obtains rt fed back by the environment according to the reward function, and then enters the next state st + 1; s6, the intelligent agent SBS updates the weight of the Actor network and the weight of the Critic network according to the feedback of the environment, and adjusts an access strategy; and S7, repeating the steps S4-S6 until the optimal Nash equilibrium is converged, and obtaining the optimal joint access action.

Description

technical field [0001] The invention belongs to the technical field of wireless communication, and relates to an A2C-based unlicensed spectrum resource sharing method. Background technique [0002] In recent years, the number of communicating devices and the amount of data exchanged between them has grown, placing a heavy burden on current cellular networks. To solve this problem, LTE network introduces many new technologies, such as massive multiple-input multiple-output MIMO, D2D communication, etc. Despite these advanced technologies, the limited licensed spectrum is still the main bottleneck for capacity improvement. In contrast, the unlicensed frequency band, especially the 5GHz unlicensed frequency band, has abundant spectrum resources and has not been fully utilized. Therefore, operating LTE networks on unlicensed bands together with legacy WiFi systems is considered a promising technology to support the explosive growth of data traffic. [0003] However, there are ...

AI Technical Summary

Problems solved by technology

There is a huge difference in spectrum resource allocation between the two. Therefore, if the LTE system operates on the same frequency band, the WiFi system may be greatly interfered, affecting the experience of WiFi users.

Images