Multi-target cloud workflow scheduling method based on reinforcement learning strategy

A reinforcement learning and workflow technology, applied in the field of cloud computing, can solve the problems of big data storage, Q-value matrix dimension explosion, high algorithm storage complexity, etc., to achieve high timeliness, improve performance, and improve generalization capabilities. Effect

Active Publication Date: 2020-05-22
BEIJING INSTITUTE OF TECHNOLOGYGY
View PDF4 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when faced with large-scale task requests, the Q-value matrix dimension explosion problem inherent in the Q-learning algorithm requires a large amount of data storage, resulting in high algorithm storage complexity; the DQN-based algorithm uses value function approximation to solve The high-dimensional data storage problem of Q-learning has been solved, but since the reinforcement learning model is trained with a fixed-dimensional environment state vector and a single type of workflow, its model generalization ability has great limitations, and it is difficult to adapt to different sizes, Different types of workflow scheduling needs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-target cloud workflow scheduling method based on reinforcement learning strategy
  • Multi-target cloud workflow scheduling method based on reinforcement learning strategy
  • Multi-target cloud workflow scheduling method based on reinforcement learning strategy

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The present invention will be described in detail below with reference to the accompanying drawings and examples.

[0025] In the prior art, a standard reinforcement learning algorithm AC (Actor-Critic Algorithm) includes an agent (Agent) and an environment, wherein, as a learning system, an Agent is composed of a policy model and a value model. The training process of the AC algorithm is as follows: the agent obtains the current state s of the external environment, takes a tentative action a on the environment, and obtains the reward r and the new state s of the action from the environmental feedback. When an action a of the agent causes the environment to generate When the reward is positive, the tendency of the agent to take this action will be strengthened; otherwise, the tendency of the agent to take this action will be weakened. In the repeated interaction between the control behavior of the learning system and the state and evaluation of environmental feedback, t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-target cloud workflow scheduling method based on a reinforcement learning strategy. A reinforcement learning Agent is improved by using a pointer network to form an improved deep reinforcement learning algorithm so as to construct a workflow scheduling model based on a reinforcement learning strategy, so that the workflow scheduling model can be suitable for cloud workflow scheduling problems of different sizes and different types, and the generalization ability of the model is improved while relatively high timeliness is ensured.

Description

technical field [0001] The invention belongs to the technical field of cloud computing, and in particular relates to a multi-objective cloud workflow scheduling method based on a reinforcement learning strategy. Background technique [0002] In recent years, more and more scientists use workflows to build their complex applications and deploy them on cloud platforms for execution. Cloud computing is the latest paradigm of distributed system computing. Its pay-per-use and elastic resource model provides an easily accessible, flexible, and scalable infrastructure and deployment environment for fast, distributed, and efficient execution of large-scale scientific workflows. But it also brings many challenges to workflow scheduling in cloud environment. On the one hand, its elastic resource mode greatly increases the scheduling solution space. On the other hand, cloud pay-per-use makes workflow scheduling need to consider workflow execution time and cost at the same time, which...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06Q10/06G06N3/04G06N3/08
CPCG06Q10/0633G06N3/08G06N3/044G06N3/045
Inventor 王彬阳李慧芳袁艳邹伟东柴森春夏元清
Owner BEIJING INSTITUTE OF TECHNOLOGYGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap