Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Resource allocation method and device based on deep reinforcement learning

A technology of reinforcement learning and resource allocation, applied in the field of wireless communication, can solve problems such as resource fragmentation, failure to consider inter-service communication requirements, and unbalanced resource allocation

Active Publication Date: 2020-07-24
BEIJING UNIV OF POSTS & TELECOMM +1
View PDF5 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, when the existing edge micro-cloud technology allocates resources for services, resource fragmentation often occurs, that is, resource allocation is unbalanced, resulting in waste of resources in a certain dimension
In addition, resource allocation not only needs to consider the resource requirements of each service, but also needs to consider the communication requirements between services, which further increases the complexity of resource allocation, and the existing related technologies do not consider the communication requirements between services

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Resource allocation method and device based on deep reinforcement learning
  • Resource allocation method and device based on deep reinforcement learning
  • Resource allocation method and device based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0076] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0077] In order to solve the technical problem of low resource utilization balance in the existing service resource allocation method in the edge micro-cloud field, the embodiment of the present invention provides a resource allocation method, device, electronic device and computer-readable method based on deep reinforcement learning. storage medium.

[0078] For ease of understanding, the application scenarios of the embodiments of the present invention are f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a resource allocation method and device based on deep reinforcement learning. The method comprises the steps of determining services of multiple to-be-allocated resources contained in an application request of a user and allocation priorities of the services; determining state parameters of the current edge micro-cloud system, wherein the state parameters comprise a resource balance degree evaluation parameter, a response delay evaluation parameter and a resource surplus of each computing node in each micro-cloud; inputting the state parameters into a pre-trained resource balance optimization model to obtain a first target computing node of the first service, wherein the resource balance optimization model is completed based on deep reinforcement learning training, and deploying the first service to a first target computing node; and updating the state parameter, and returning to the parameter input step until the service of each to-be-allocatedresource contained in the application program request completes resource allocation. Compared with a traditional resource allocation method, the method has the advantages that the communication delayrequirement can be met, and the high resource utilization balance degree can be achieved.

Description

technical field [0001] The present invention relates to the field of wireless communication technology, in particular to a resource allocation method and device based on deep reinforcement learning. Background technique [0002] In recent years, with the continuous development of informatization and networking, information systems have played an increasingly important role in military, disaster relief and other fields. In this highly dynamic environment, mission plans and equipment composition may change frequently, and network connectivity may fluctuate. The service resources based on stand-alone devices are very limited and cannot cope with complex computing tasks. Cloud computing technology is an effective means to deal with this scenario. In cloud computing technology, resource configuration can be customized according to task requirements, so as to provide convenient and flexible management services for large-scale applications. However, traditional cloud platforms ar...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/50G06N3/04G06N3/08
CPCG06F9/5072G06F9/5083G06N3/08G06F2209/5021G06N3/045
Inventor 张海涛郭彤宇郭建立黄瀚何晨泽
Owner BEIJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products