Decision-making method for optimal allocation of resources based on deep reinforcement learning and blockchain consensus

A technology of reinforcement learning and decision-making methods, applied in resource allocation, resources, multi-programming devices, etc., can solve the problem of prolonging the working hours of the controller group, achieve weighting and overhead reduction, and extend the working hours

Active Publication Date: 2022-06-07
BEIJING UNIV OF TECH
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method solves the problem of how to determine the optimal resource allocation strategy when there are multiple cells, multiple controllers, multiple base stations, and multiple MEC servers in the scenario, and effectively reduces the energy consumption of the main controller by implementing the optimal resource allocation strategy , system economic overhead, and extend the working hours of the controller group

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Decision-making method for optimal allocation of resources based on deep reinforcement learning and blockchain consensus
  • Decision-making method for optimal allocation of resources based on deep reinforcement learning and blockchain consensus
  • Decision-making method for optimal allocation of resources based on deep reinforcement learning and blockchain consensus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0073] The following is a further description of the technical solution of the industrial Internet resource optimization and allocation decision-making method based on deep reinforcement learning and blockchain consensus in conjunction with the accompanying drawings and examples.

[0074] The flow chart of the method of the present invention is as follows figure 2 shown, including the following steps:

[0075] Step 1: System initialization, setting the number of cells, the number of consensus nodes in the blockchain system, the number of servers used to serve the blockchain consensus process, the power of the controller, the transmission rate of the base station, etc.;

[0076] Step 2, according to the actual situation, calculate the energy consumption E of the main controller processing data c , the transmission energy consumption E generated by offloading computing tasks s and economic expenses M s , the energy consumption E of the main controller to transmit the transac...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a resource optimization allocation decision method based on deep reinforcement learning and block chain consensus. By constructing a computing task model and a server state model, the energy consumption and economic overhead of local computing and offloading computing of the main controller are calculated, and the block chain The computational economic overhead generated by the consensus process can guide the adjustment of controller selection, offloading decision, block size and server selection through training deep neural network and policy network, and complete the optimal resource allocation in the scene. The invention overcomes the problems of industrial Internet data security, high energy consumption of equipment due to processing calculation tasks, short working cycle, and high overall economic cost of the system. Simulation experiments show that the industrial Internet resource optimization allocation decision-making method based on deep reinforcement learning and blockchain consensus proposed by the present invention has certain advantages in saving controller energy consumption, system economic overhead and prolonging the total working time of controller groups.

Description

technical field [0001] The invention relates to a decision-making method for industrial Internet resource optimization and allocation based on deep reinforcement learning and blockchain consensus. Through the deep reinforcement learning algorithm, a method for optimizing resource allocation strategies for industrial Internet data in each community in the process of blockchain consensus is designed. , a decision-making optimization method for effectively reducing system economic overhead and controller energy consumption, belonging to the related fields of resource allocation and system decision-making. Background technique [0002] Currently, the rapid development of the Industrial Internet has attracted a lot of attention from industry and academia. The application of industrial Internet technology realizes efficient and convenient interaction between machines and machines, and between machines and people. Various types of industrial Internet devices, also known as machine...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06Q10/06G06Q40/04G06Q50/30G06F9/50
CPCG06Q10/06313G06Q40/04G06Q50/30G06F9/5083Y02D10/00
Inventor 李萌杨乐张延华杨睿哲吴文君司鹏搏
Owner BEIJING UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products