A resource allocation optimization method and system based on reinforcement learning

A technology of reinforcement learning and resource allocation, applied in neural learning methods, biological neural network models, electrical components, etc., can solve problems such as affecting scheduling performance

Active Publication Date: 2019-05-10
CHANGSHA UNIVERSITY
View PDF6 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Aiming at the above defects or improvement needs of the prior art, the present invention provides a resource allocation optimization method and system based on reinforcement learning. The local optimal solution situation caused by it will affect the technical problem of scheduling performance, and the present invention builds an allocation model based on historical allocation data, which has universal applicability and evolution

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A resource allocation optimization method and system based on reinforcement learning
  • A resource allocation optimization method and system based on reinforcement learning
  • A resource allocation optimization method and system based on reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0079] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

[0080] The overall idea of ​​the present invention is to propose a resource allocation optimization method based on reinforcement learning, which first constructs a relevant Markov state transition model based on the characteristics of downlink resource scheduling; A resource scheduling model for reinforcement learning.

[0081] Such as Figure 16 As shown, the resource allocation optimization...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a resource allocation optimization method based on reinforcement learning. The method comprises the following steps: acquiring a bandwidth value of a downlink, acquiring the number of physical resource blocks which can be called within a single transmission time interval according to the bandwidth value, and acquiring the number of user services to be transmitted, the characteristics of the user services to be transmitted on an nth physical resource block at the current t moment, and Characteristics of the whole downlink at the t-1 moment; judging whether the bandwidthutilization rate of the downlink needs to be improved; and if the bandwidth utilization rate of the downlink needs to be improved, whether the fairness of the downlink needs to be improved or not, orthe trade-off of the bandwidth utilization rate and the fairness of the downlink needs to be realized, and if the bandwidth utilization rate of the downlink needs to be improved, inputting the characteristics into the trained bandwidth utilization rate reinforcement learning model to obtain the metric value of the ith user service on the nth resource block. The technical problem that the scheduling performance is affected due to the fact that an existing algorithm only considers the local optimal solution condition caused by optimal allocation of a single resource block can be solved.

Description

technical field [0001] The invention belongs to the technical field of wireless communication, and more specifically, relates to a resource allocation optimization method and system based on reinforcement learning. Background technique [0002] As a mainstream wireless communication network, a long term evolution (Long term evolution, LTE for short) network has been widely used at present. Downlink scheduling is a very important link in the existing LTE network. Currently, downlink scheduling methods commonly used mainly include Proportional fair (PF) algorithm, Max channel quality indicator (Max- CQI) algorithm, Modified Largest Weighted Delay First (M-LWDF for short) algorithm, and Exponential proportional fair (Exponentialproportional fair, EXP / PF for short) algorithm. [0003] However, the allocation strategy of the above-mentioned LTE downlink scheduling algorithm only considers the optimal allocation of a single resource block. Although it is possible to obtain the op...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04W72/04H04W72/12G06N3/08G06N3/04
Inventor 李方敏曾源远李扬帆张韬周舟彭小兵
Owner CHANGSHA UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products