Multi-user task scheduling method and device in computing cluster

A computing cluster and task scheduling technology, applied in the computer field, can solve the problem that the execution efficiency of the computing engine cannot be reliably guaranteed.

Active Publication Date: 2019-12-10
TRANSWARP INFORMATION TECH SHANGHAI
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] One purpose of this application is to provide a multi-user task scheduling method and device in a computing cluster, which can solve the problem that the existing scheduler scheduling scheme cannot reliably guarantee the task execution efficiency of the computing engine under multi-user and mixed load scenarios

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-user task scheduling method and device in computing cluster
  • Multi-user task scheduling method and device in computing cluster
  • Multi-user task scheduling method and device in computing cluster

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0091] The application will be described in further detail below in conjunction with the accompanying drawings.

[0092] In a typical configuration of the present application, the terminal, the device serving the network and the trusted party all include one or more processors (CPUs), input / output interfaces, network interfaces and memory.

[0093] Memory may include non-permanent storage in computer-readable media, in the form of random access memory (RAM) and / or nonvolatile memory, such as read-only memory (ROM) or flash memory (flashRAM). Memory is an example of computer readable media.

[0094]Computer-readable media, including both permanent and non-permanent, removable and non-removable media, can be implemented by any method or technology for storage of information. Information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), stat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention aims to provide a multi-user task scheduling method and device for a calculation cluster. The current residual task quantity quotas of users are determined by determining the current residual resource quantity quotas of servers in the calculation cluster, a current cluster load can be actively sensed, tasks smaller than or equal to the current residual task quantity quotas of the users in quantity are screened out from newly received tasks, the tasks sorted according to the task priority are allocated to corresponding used nodes in a resource pool according to the users to which the tasks are subordinate, node priority sorting is conducted on all the nodes without fixed resource pool pre-designation for the tasks, scheduling strategies are fixed without configuration with a scheduler and can be dynamically generated, flexible and dynamic calculation resource allocation of the calculation cluster is achieved, and finer resource allocation and task scheduling are achieved.

Description

technical field [0001] The present application relates to the field of computers, in particular to a multi-user task scheduling method and device in a computing cluster. Background technique [0002] Big data technology relies on massive amounts of data, and such new types of data processing tasks are beyond the capabilities of a single computer, requiring the use of distributed computing clusters (computing engines). The distributed computing engine divides large-scale processing tasks into small tasks of the same type in several intermediate processing stages, and then distributes them to different distributed nodes for calculation. How to distribute the received tasks is the responsibility of the engine scheduling module (scheduler). [0003] On a distributed computing platform, often many users such as multi-tenants use the same computing cluster, and use the cluster to run different types of computing tasks (mixed load). In such a scenario, how to allocate resources r...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4881G06F9/5038
Inventor 陈夏明吕程刘汪根
Owner TRANSWARP INFORMATION TECH SHANGHAI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap