An intelligent decision-making method for data packet transmission based on deep reinforcement learning

A technology of reinforcement learning and intelligent decision-making, applied in the field of wireless communication, it can solve problems such as difficult optimization effects, and achieve the effect of improving intelligent decision-making ability, reducing data transmission energy consumption, and solving poor optimization effects.

Active Publication Date: 2022-03-18
ANHUI UNIV OF SCI & TECH
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At the same time, considering the uncertainty of the data packet size and the number of requests, as well as the strong demand of users for transmission delay, traditional algorithms cannot comprehensively consider many constraints and reduce transmission energy consumption when dealing with such complex and dynamic data transmission requirements. , it is difficult to obtain the ideal optimization effect

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An intelligent decision-making method for data packet transmission based on deep reinforcement learning
  • An intelligent decision-making method for data packet transmission based on deep reinforcement learning
  • An intelligent decision-making method for data packet transmission based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] like figure 2 As shown, an intelligent decision-making method for data packet transmission based on deep reinforcement learning, the method includes the following sequential steps:

[0040] (1) Construct a deep neural network model, which includes an original value neural network for calculating the behavioral value function, and a target value neural network for behavior selection based on the calculation results of the behavioral value function;

[0041] (2) Design and initialize state space and behavior space;

[0042] (3) Obtain the current state information and historical state information of data transmission, enter the state space, and optimize and allocate the transmission order and transmission power of data packets;

[0043] (4) Use the experience playback mechanism to save historical state information, and randomly collect training samples for deep neural network training;

[0044] (5) According to the total number of data packets T, step (3) and step (4) ar...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an intelligent decision-making method for data packet transmission based on deep reinforcement learning, including: constructing a deep neural network model; designing and initializing state space and behavior space; obtaining current state information and historical state information of data transmission, and inputting state space; adopting The experience playback mechanism saves historical state information; iteratively executes steps (3) and (4) T times, and the round ends; updates the target value neural network parameter θ′, and assigns the latest parameter θ of the original value neural network to the target value neural network ; Iteratively execute steps (2) to (5) until the number of iterations reaches the preset round upper limit N or the deep neural network converges, then terminate and automatically obtain a data transmission strategy that satisfies multiple constraints and lower energy consumption. The invention improves the service quality of users, reduces the energy consumption of data transmission at the same time, and effectively improves the intelligent decision-making ability of data transmission in a communication network in a highly complex and dynamic environment.

Description

technical field [0001] The invention relates to the technical field of wireless communication, in particular to an intelligent decision-making method for data packet transmission based on deep reinforcement learning. Background technique [0002] With the development of the Internet of Things and the large-scale popularization of mobile terminals, wireless traffic has surged, and energy consumption caused by data transmission has also increased significantly. In addition, with the introduction of new concepts such as green networks and smart networks, reducing energy consumption has become increasingly important. How to reasonably formulate data transmission strategies to achieve stable data transmission and reduce transmission energy consumption while ensuring user service experience has become a topic of great concern. [0003] Data transmission in the current context is becoming complex, diverse and dynamic, and data transmission decisions are faced with the test of a hu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04W72/04G06N3/04G06N3/08
CPCG06N3/08G06N3/045H04W72/53Y02D30/70
Inventor 葛斌李孜恒方贤进杨高明
Owner ANHUI UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products