Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Scheduling method, scheduler, storage medium and system

A scheduling method and scheduler technology, applied in the field of communications, can solve problems such as long job execution time, affecting cloud computing system performance, and low computing efficiency.

Active Publication Date: 2019-10-01
HUAWEI TECH CO LTD
View PDF13 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The calculation process will be affected by the distribution of data. For example, if the data required by a certain job request is distributed on different servers, when a server is performing calculations according to the job request, it needs to transmit all data from other servers. required data, which results in data transfer across nodes
However, the storage location of the data in the above scheduling process is fixed, and the scheduling effect can only depend on the initial data distribution. If the initial data distribution is not good, there will be a large amount of cross-node data transmission in the calculation process, and then The job execution time is too long and the calculation efficiency is low, which affects the performance of the cloud computing system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Scheduling method, scheduler, storage medium and system
  • Scheduling method, scheduler, storage medium and system
  • Scheduling method, scheduler, storage medium and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0116] In order to make the purpose, technical solution and advantages of the present disclosure clearer, the implementation manners of the present disclosure will be further described in detail below in conjunction with the accompanying drawings.

[0117] figure 2 is a schematic diagram of the architecture of a cloud computing system provided by an embodiment of the present disclosure, see figure 2 , the cloud computing system includes: a job layer and a platform layer, the job layer includes a scheduler 201 , and the platform layer includes multiple servers 202 .

[0118] Multiple servers 202 are used as storage nodes to store data, and are also used as computing nodes to perform calculations according to data and job requests, and multiple servers 202 are connected to each other for data transmission.

[0119] The scheduling layer 201 is used to schedule the received job requests to one or more computing nodes (servers 202 ), so that computing can be performed on the com...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a scheduling method, a scheduler, a storage medium and a system, and belongs to the technical field of communication. The scheduling method comprises the steps: acquiring an incidence relation graph and data distribution information, wherein each node in the incidence relation graph refers to one piece of data, and each directed edge is used for representing an operation request for calculating according to the data referenced by a source node to obtain the data referenced by a target node; according to a preset node sorting strategy, sequentially positioning the operation requests corresponding to the traversed nodes to any server where the data indicated by the traversed nodes are located; and sequentially scheduling at least one job request represented by at leastone directed edge to the positioned server. For the scheduling method, the incidence relation graph is used for representing the incidence relation between the data and the corresponding relation between the operation requests and the data, and the data distribution information is used for representing the data distribution condition, so that cross-node data transmission can be reduced, the operation execution time of the whole operation request is shortened, and the calculation efficiency is improved, and the system performance is improved.

Description

technical field [0001] The present disclosure relates to the technical field of communication, and in particular to a scheduling method, a scheduler, a storage medium and a system. Background technique [0002] With the growth of data scale and the development trend of data diversity, data analysis and processing technology is also constantly improving. At present, a variety of data analysis and processing architectures have emerged, such as Hadoop / MapReduce (distributed computing / mapping and merging) architecture , Spark, a big data processing framework based on memory computing, etc. Big data applications developed based on these data analysis and processing architectures can improve the efficiency of big data analysis and processing, and meet the real-time requirements of big data analysis and processing to a certain extent. [0003] When implementing big data applications, it is necessary to build a computing cluster with a certain scale, and dynamically adjust the comp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/48
CPCG06F9/4881G06F9/48G06F17/00G06F16/9032G06F16/90335H04L67/63
Inventor 徐聪刘浏张海波
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com