Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A coflow scheduling method based on deep reinforcement learning

A technology of reinforcement learning and scheduling methods, applied in digital transmission systems, data exchange networks, biological neural network models, etc., can solve problems such as limiting the final effect of scheduling, suboptimal thresholds, complex network environments, etc., and achieve flexible scheduling strategies , Reduce overhead and improve processing efficiency

Active Publication Date: 2021-09-24
BEIHANG UNIV
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The multi-level feedback queue has the advantages of small scheduling delay and can effectively distinguish between long flow and short flow, but there are still defects, that is, the threshold value often needs to be manually set in advance, which is empirical, and the network environment is complex and changes frequently. Thresholds are often not optimal, which limits the final effect of scheduling

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A coflow scheduling method based on deep reinforcement learning
  • A coflow scheduling method based on deep reinforcement learning
  • A coflow scheduling method based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0048] The present invention is based on the working principle of deep reinforcement learning. Among them, reinforcement learning is an important branch of machine learning. In reinforcement learning, there is an agent for interacting with the environment. The agent takes corresponding actions by observing the state of the environment to obtain the maximum reward value feedback. Reinforcement learning is usually formulated using a ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a Coflow scheduling method based on deep reinforcement learning. Based on deep reinforcement learning and combined with multi-level priority queues and basic flow scheduling algorithms, the Coflow scheduling strategy is formally expressed by establishing a Markov decision model, and then Complete the adjustment of the Coflow scheduling strategy. The present invention uses the data size, the total number of flows, the number of active flows and the duration of Coflow in the current network environment to form a state matrix to represent the network state, define the action of adjusting the flow transmission multi-level priority queue, establish an evaluation equation, and realize the Coflow Minimal optimization for average completion time. The present invention combines deep reinforcement learning and multi-level priority queues, adjusts the Coflow scheduling strategy through a lot of trial and error and learning in the Coflow sending scheduling environment, and incorporates more environmental parameters compared with the traditional heuristic algorithm, effectively improving the Coflow transfer efficiency.

Description

technical field [0001] The present invention relates to Coflow scheduling, and more particularly, to a Coflow scheduling method based on deep reinforcement learning. Background technique [0002] Big data computing frameworks headed by Apache Spark are often used in computing tasks such as data mining and machine learning. They use a distributed architecture to divide the input data and assign the divided small data blocks to different computing nodes for operation. , and then redistribute and calculate after the data processing is completed. After one or more iterations, the desired result is finally obtained. With the execution of the above computing application, a large number of communication flows for transmitting data will be generated between different nodes (Nodes) in the cluster. These communication flows have high parallelism and occupy most of the application running process, which profoundly affects the computing process of big data applications. Therefore, fin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L12/865G06N3/04H04L47/6275
CPCH04L47/6275G06N3/045
Inventor 李巍孙禹康陈天霸李云春
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products