Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

D2D communication network slice allocation method based on deep reinforcement learning

A technology of reinforcement learning and communication network, applied in the field of D2D communication network slice allocation based on deep reinforcement learning, can solve the problem that the agent cannot obtain the strategy, achieve the effect of improving efficiency, optimizing experience quality, and meeting communication requirements

Active Publication Date: 2021-07-23
SUN YAT SEN UNIV
View PDF3 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This patent also has the problem of DQN's deep reinforcement learning. The estimated error will be transmitted and increased with the execution of the action, and eventually the agent cannot obtain the optimal strategy.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • D2D communication network slice allocation method based on deep reinforcement learning
  • D2D communication network slice allocation method based on deep reinforcement learning
  • D2D communication network slice allocation method based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0083] This embodiment provides a D2D communication network slice allocation method based on deep reinforcement learning, such as figure 1 shown, including the following steps:

[0084] S1: Classify communication services according to service types, and establish resource allocation models for multi-service slices and D2D slices;

[0085] S2: Construct a reinforcement learning model for slice resource allocation based on the Dueling DDQN algorithm;

[0086] S3: Define the current state s of the business slice, the state s′ at the next moment, the current action a, and the reward r of the system constructed by the state and action for the agent in the Dueling DDQN algorithm;

[0087] S4: Use experience playback to learn Dueling DDQN, and finally get the optimal solution for slice resource allocation.

[0088] In step S1, the communication services are classified according to service types, specifically, they are divided into control, data collection, media and D2D communicati...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a D2D communication network slice allocation method based on deep reinforcement learning. The method comprises the following steps: S1, classifying communication services according to service types, and building a multi-service slice and D2D slice resource allocation model; s2, constructing a reinforcement learning model of slice resource allocation according to a Dueling DDQN algorithm; s3, defining a current state s, a next moment state s' and a current action a of a service slice for an agent in the Dueling DDQN algorithm, and constructing a reward r of a system by the states and the actions; and S4, learning of Dueling DDQN is carried out by using experience playback, and finally, an optimal solution of slice resource allocation is obtained. According to the method, resource allocation is carried out on the multi-service slices and the D2D slices, the multi-service slices and the D2D slices correspond to different uRLLC slices, mMTC slices, eMBB slices and D2D slices, a resource allocation model based on deep reinforcement learning is constructed in combination with a network slicing technology and a Duelling DDQN reinforcement learning algorithm, the slice resource allocation efficiency is improved, the communication requirements of various services are met, and the experience quality is optimal.

Description

technical field [0001] The present invention relates to the technical field of mobile Internet communication, and more specifically, to a method for allocating D2D communication network slices based on deep reinforcement learning. Background technique [0002] The popularity of the Internet has profoundly affected people's production, living and learning methods, and the Internet has become one of the important infrastructures supporting the development of modern society and technological progress. The advent of the 5G era has brought many excellent performances to wireless communications. 5G will greatly increase the transmission rate of communication, support massive device connections, and provide excellent performance with ultra-high reliability and ultra-low latency. 5G wireless networks support diverse business scenarios in different vertical industries, such as autonomous driving, smart home, augmented reality, etc. These business scenarios have different communicati...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04W28/16H04W72/04G06N3/08
CPCH04W28/16G06N3/08H04W72/53
Inventor 刘元杰伍沛然夏明华
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products