A D2D user resource allocation method based on a deep reinforcement learning DDPG algorithm

Abstract

The invention discloses a D2D user resource allocation method based on a deep reinforcement learning DDPG algorithm. According to the invention, cellular users and D2D user related information are utilized; an optimal D2D user channel allocation and transmitting power combined optimization strategy is obtained by utilizing a deep reinforcement learning method; D2D users select appropriate transmitting power and distribution channels to reduce interference to cellular users and maximize own information rate, efficient resource distribution is achieved under the condition that QoS of the cellular users is not affected, the throughput of a cellular network is improved, and the requirement for green communication is met. The DDPG algorithm effectively solves the joint optimization problem of D2D user channel distribution and power control; t the method is stable in performance in optimization of a series of continuous action spaces, the time step required for solving the optimal solution is far less than that required by DQN, and compared with a DRL method based on a value function, the deep strategy gradient method based on the AC framework is higher in strategy optimization efficiency and higher in solving speed.

Description

technical field [0001] The invention belongs to the technical field of wireless communication, and more specifically, relates to a D2D user resource allocation method based on a deep reinforcement learning DDPG algorithm. Background technique [0002] With the increasing local wireless communication services, the pressure on the cellular network is increasing. As one of the key technologies of 5G communication, D2D (Device-to-Device) technology allows adjacent terminals to directly share data with each other under the control of the base station, forming a data sharing network and sharing the channel resources of the cellular network. To achieve the purpose of reducing the burden on the base station, improving spectrum utilization, and improving system throughput. [0003] D2D communication is a new technology that allows terminals to communicate directly through shared cell resources. It can increase the spectrum utilization efficiency of the cellular system, reduce the lo...

AI Technical Summary

Problems solved by technology

[0005] Aiming at the defects of the existing technology, the purpose of the present invention is to solve the technical problem that in the prior art, when the D2D users share the channel of the cellular user, it will cause interference to the users who have already accessed and affect the performance of the users.

Images