Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-task reinforcement learning method for realizing parallel task scheduling

A technology of reinforcement learning and task scheduling, applied in the fields of information, distribution and parallel computing, it can solve problems such as the difficulty of accurate modeling and the difficulty of heuristic algorithms to show scheduling performance, and achieve the effect of improving generalization.

Inactive Publication Date: 2019-12-17
BEIJING UNIV OF POSTS & TELECOMM
View PDF5 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the computing platform environment is always dynamic and large-scale, and it is very difficult to accurately model them, so it is difficult for heuristic algorithms to show excellent scheduling performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-task reinforcement learning method for realizing parallel task scheduling
  • Multi-task reinforcement learning method for realizing parallel task scheduling
  • Multi-task reinforcement learning method for realizing parallel task scheduling

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0039] see figure 1 , introduce a kind of multi-task reinforcement learning method that realizes parallel task scheduling that the present invention proposes, realize based on the Asynchronous Advantage Actor-Critic algorithm of asynchronous advantage performer critic, described method comprises the following operation steps:

[0040] (1) Perform the following setting operations on the Asynchronous Advantage Actor-Critic algorithm model to better solve the parallel multi-task scheduling problem:

[0041] (1.1) set the state space S as a set, that is: S={F task ,L,T,F node}, where,

[0042] f task ={f 1 , f 2 , f 3 ,..., f M} represents the CPU instruction number of a job, where M is a natural number, representing the maximum number of subtasks of a job; f ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A multi-task reinforcement learning method for realizing parallel task scheduling is realized based on an asynchronous advantage actor-critic algorithm, and comprises the following operation steps: (1) setting an algorithm model to better solve the parallel multi-task scheduling problem, including setting a state space, setting an action space and setting an award definition; (2) improving the algorithm network as follows: using a deep neural network to represent a strategy function and a value function, wherein the global network is composed of an input layer, a shared sub-network and an output sub-network; (3) setting a new loss function of the algorithm; and (4) training the algorithm network by utilizing the collected and observed parallel task scheduling data, and applying the algorithm network to parallel task scheduling after algorithm convergence.

Description

technical field [0001] The invention relates to a multi-task reinforcement learning method for realizing parallel task scheduling, which belongs to the field of information technology, in particular to the technical field of distribution and parallel computing. Background technique [0002] In the era of data explosion, distribution and parallelization have become an effective way of data processing. Cloud computing, fog computing, edge computing, etc. are all typical distributed and parallel computing environments for big data processing. The computing resources of these computing systems are limited, so the rational allocation of resources is always a crucial research topic. In addition, sustainable development has become a global focus in recent years, and power consumption in computing centers can cause huge energy losses. In view of the above reasons, in a complex dynamic network environment, how to allocate tasks to effectively utilize distributed resources, achieve ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/48G06N3/08
CPCG06F9/4881G06N3/084G06N3/006G06N3/08G06N5/043G08G1/0125G06N3/047
Inventor 戚琦孙海峰王晶张凌昕王敬宇廖建新
Owner BEIJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products