Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Job scheduling method and system

A job scheduling and job technology, applied in the computer field, can solve problems such as bottlenecks, scheduling, and inability to well support scheduling needs, and achieve the effect of clear division of labor and improved scheduling performance

Active Publication Date: 2020-02-21
CHINA CONSTRUCTION BANK
View PDF6 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] 1. It cannot well support scheduling requirements in complex scenarios, such as cross-job flow dependencies, event triggers, etc.;
[0005] 2. It cannot directly support the multi-tenant environment, and scheduling bottlenecks often occur when the scheduling level reaches millions or even tens of millions;
[0006] 3. The management support for scheduling resources is weak

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Job scheduling method and system
  • Job scheduling method and system
  • Job scheduling method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] Exemplary embodiments of the present invention are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present invention to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0045] In the introduction of the embodiments of the present invention, the definitions of some terms that occur are as follows:

[0046] Tenant: In the public cloud environment, it can be understood as a certain customer. In simple terms, multi-tenancy is to realize the sharing of system instances between multiple tenants, and to ensure the isolation of data and resources...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a job scheduling method and a system, and relates to the technical field of computers. One specific embodiment of the method comprises the following steps: analyzing a receivedtrigger event into input conditions of jobs, and putting the jobs into a job set after all the input conditions of the jobs are ready; taking out to-be-distributed jobs from the job set and distributing the jobs; and obtaining job instance information from the distributed job queue and executing jobs. According to the method, common polling in the scheduling process can be avoided, and the scheduling performance is greatly improved; the whole job scheduling adopts a decentralized design and is executed by a plurality of independent components in series, and the components are clear in division of labor and are decoupled from one another through message queues, so that system expansion can be performed by simply adding examples.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a job scheduling method and system. Background technique [0002] Job scheduling in a multi-tenant environment faces the following challenges: 1. With the increase of tenants, the number of daily running tasks can reach more than one million, and due to different business fields, there are complex relationships among jobs. Dependency, different jobs have different running frequency requirements, and even time zone differences; 2. Heterogeneous and diverse computing platforms (such as Hadoop platform, stream computing platform, massively parallel processing MPP platform, etc.), Heterogeneous platforms determine the complexity of scheduling job types, including script jobs such as Shell and Python, big data tasks such as Spark and Hive, and container tasks under the microservice framework; 3. Complex resource management, multiple In a tenant environment, it is necessary ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/54
CPCG06F9/546
Inventor 赖海滨洪少辉翁世清陈守当黄启成周怡臻林思远
Owner CHINA CONSTRUCTION BANK
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products