Energy harvesting D2D communication resource allocation method based on reinforcement learning

A technology for communication resource allocation and energy collection, applied in network traffic/resource management, wireless communication, energy consumption reduction, etc.

Active Publication Date: 2020-02-11
NANJING UNIV OF POSTS & TELECOMM
View PDF5 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, when D2D communication and traditional cellular communication use the same spectrum resources, there is mutual in

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Energy harvesting D2D communication resource allocation method based on reinforcement learning
  • Energy harvesting D2D communication resource allocation method based on reinforcement learning
  • Energy harvesting D2D communication resource allocation method based on reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] The overall flow chart of the energy harvesting D2D communication resource allocation method based on reinforcement learning studied in the present invention is as follows figure 1 As shown, including the following steps:

[0040] 1. Establish the optimization problem of the total capacity of downlink cellular users and D2D users in maximization mode B:

[0041] Such as figure 2 As shown, consider the single-cell model. The cell includes a base station located in the center of the cell, I uplink cellular users, M downlink cellular users, and N pairs of D2D users, using UCU={UCU 1 ,...,UCU i ,...,UCU I }, DCU = {DCU 1 ,...,DCU m ,...,DCU M } And DU = {DU 1 ,...,DU n ,...,DU N }Represent the uplink cellular user set, downlink cellular user set and D2D user set, where UCU i , DCU m And DU n Denote uplink cellular user i, downlink cellular user m, and D2D user n respectively. Each D2D user pair includes a D2D transmitter and a D2D receiver.

[0042] Uplink cellular users occupies...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an energy harvesting D2D communication resource allocation method based on reinforcement learning. In the method, a D2D sending end directly communicates with a D2D receiving end by adopting a mode A, or communicates with the D2D receiving end by applying an NOMA technology while adopting a mode B as a relay to assist cellular communication. Firstly, an outage probability expression when a user adopts different modes for communication is deduced; and then it is assumed that energy collection and channel state information at all moments are known, channels are allocatedfor the D2D users and relays are selected for the cellular users by utilizing a KM algorithm, and the sending power of the D2D users is optimized by utilizing a reinforcement learning method by considering energy causality constraints and maximum sending power limits. According to the method, the D2D sending end is considered to be capable of serving as a relay to assist edge cellular user communication, resource allocation of D2D users and cellular users is optimized under the condition that user service quality and energy constraints are met, the total capacity of the D2D users and mode B cellular users can be improved, and more edge cellular users are allowed to have access to a network.

Description

Technical field [0001] The present invention belongs to the field of wireless communication technology, and specifically relates to a method for allocating energy collection D2D communication resources based on reinforcement learning. Background technique [0002] With the development of Internet technology, more and more users need to access wireless networks. However, spectrum resources are limited. How to use the limited spectrum resources to enable more users to perform wireless communication has become an urgent problem to be solved. D2D communication allows the establishment of a direct communication link between two user terminals that are physically close, and point-to-point communication is performed by reusing the authorized frequency band of the cellular network. Due to the shared spectrum resources, D2D communication allows more user terminals to access the network. Relay technology can improve the coverage of a cell by receiving and forwarding signals. Combining D2...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04W24/02H04W28/02H04W72/08H04B17/336H04B17/382
CPCH04W28/0221H04W28/0236H04W24/02H04B17/336H04B17/382H04W72/542Y02D30/70
Inventor 朱琦苏娜
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products