Resource optimal allocation decision-making method based on deep reinforcement learning and blockchain consensus

A technology of reinforcement learning and decision-making methods, applied in resource allocation, resource, program control design, etc., can solve problems such as prolonging the working hours of controller groups

Active Publication Date: 2020-08-07
BEIJING UNIV OF TECH
View PDF6 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method solves the problem of how to determine the optimal resource allocation strategy when there are multiple cells, multiple controllers, multiple base stations, and multiple MEC servers in the scenario, and effectively reduces the energy consumption of the main controller by implementing the optimal resource allocation strategy , system economic overhead, and extend the working hours of the controller group

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Resource optimal allocation decision-making method based on deep reinforcement learning and blockchain consensus
  • Resource optimal allocation decision-making method based on deep reinforcement learning and blockchain consensus
  • Resource optimal allocation decision-making method based on deep reinforcement learning and blockchain consensus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0074] The following is a further description of the technical solution of the industrial Internet resource optimization allocation decision-making method based on deep reinforcement learning and blockchain consensus in combination with the accompanying drawings and examples.

[0075] Method flow chart of the present invention is as figure 2 shown, including the following steps:

[0076] Step 1, system initialization, setting the number of cells, the number of blockchain system consensus nodes, the number of servers used to serve the blockchain consensus process, the power of the controller, the transmission rate of the base station, etc.;

[0077] Step 2. According to the actual situation, calculate the energy consumption E of the main controller to process data c , Transmission energy consumption E generated by offloading computing tasks s and economic expenditure M s , The energy consumption E of the main controller to transmit transactions to the blockchain system n A...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a resource optimal allocation decision-making method based on deep reinforcement learning and blockchain consensus. The method comprises the steps: constructing a calculation task model and a server state model; calculating the energy consumption and economic overhead of local calculation and unloading calculation of the main controller, and the calculation economic overhead generated in the blockchain consensus process, thereby guiding and adjusting controller selection, unloading decision, block size and server selection through training a deep neural network and a strategy network, and completing optimal resource allocation in a scene. According to the invention, the problems of industrial Internet data security, over-high energy consumption of equipment due to processing of calculation tasks, short working period, over-high overall economic overhead of the system and the like are solved. Simulation experiments show that the industrial Internet resource optimal allocation decision-making method based on deep reinforcement learning and blockchain consensus has certain advantages in the aspects of saving controller energy consumption and system economic overhead and prolonging the total working duration of a controller group.

Description

technical field [0001] The invention relates to a decision-making method for optimal allocation of industrial Internet resources based on deep reinforcement learning and block chain consensus. Through deep reinforcement learning algorithms, a kind of industrial Internet data in each community is designed in the process of block chain consensus, through optimizing the resource allocation strategy. , a decision-making optimization method that effectively reduces system economic overhead and controller energy consumption, belongs to the related fields of resource allocation and system decision-making. Background technique [0002] Currently, the rapid development of the industrial Internet (Industrial Internet) has attracted a lot of attention from industry and academia. The application of industrial Internet technology realizes the efficient and convenient interaction between machines and machines, and between machines and people. Various types of industrial Internet devices,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06Q10/06G06Q40/04G06Q50/30G06F9/50
CPCG06Q10/06313G06Q40/04G06Q50/30G06F9/5083Y02D10/00
Inventor 李萌杨乐张延华杨睿哲吴文君司鹏搏
Owner BEIJING UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products