A d2d user resource allocation method based on deep reinforcement learning ddpg algorithm

Abstract

The present invention discloses a D2D user resource allocation method based on the deep reinforcement learning DDPG algorithm. The present invention uses relevant information of cellular users and D2D users to obtain the optimal D2D user channel allocation and transmission power joint optimization strategy by using the deep reinforcement learning method , D2D users reduce the interference to cellular users by selecting appropriate transmit power and channel allocation, and at the same time maximize their own information rate, realize efficient resource allocation without affecting the QoS of cellular users, and improve the throughput of cellular networks The amount meets the requirements of green communication. The DDPG algorithm effectively solves the joint optimization problem of D2D user channel allocation and power control. It not only performs stably in the optimization of a series of continuous action spaces, but also requires far fewer time steps to obtain the optimal solution than DQN. Compared with the DRL method of the function, the deep policy gradient method based on the AC framework is more efficient in optimizing the strategy and faster in solving speed.

Description

technical field [0001] The invention belongs to the technical field of wireless communication, and more specifically, relates to a D2D user resource allocation method based on a deep reinforcement learning DDPG algorithm. Background technique [0002] With the increasing local wireless communication services, the pressure on the cellular network is increasing. As one of the key technologies of 5G communication, D2D (Device-to-Device) technology allows adjacent terminals to directly share data with each other under the control of the base station, forming a data sharing network and sharing the channel resources of the cellular network. To achieve the purpose of reducing the burden on the base station, improving spectrum utilization, and improving system throughput. [0003] D2D communication is a new technology that allows terminals to communicate directly through shared cell resources. It can increase the spectrum utilization efficiency of the cellular system, reduce the lo...

AI Technical Summary

Problems solved by technology

[0005] Aiming at the defects of the existing technology, the purpose of the present invention is to solve the technical problem that in the prior art, when the D2D users share the channel of the cellular user, it will cause interference to the users who have already accessed and affect the performance of the users.

Images