Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Method and system for job scheduling

A job scheduling and job technology, which is applied in the computer field, can solve problems such as bottlenecks, scheduling, and weak support for scheduling resource management, and achieve a clear division of labor and improve scheduling performance.

Active Publication Date: 2022-06-28
CHINA CONSTRUCTION BANK
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] 1. It cannot well support scheduling requirements in complex scenarios, such as cross-job flow dependencies, event triggers, etc.;
[0005] 2. It cannot directly support the multi-tenant environment, and scheduling bottlenecks often occur when the scheduling level reaches millions or even tens of millions;
[0006] 3. The management support for scheduling resources is weak

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for job scheduling
  • Method and system for job scheduling
  • Method and system for job scheduling

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] Exemplary embodiments of the present invention are described below with reference to the accompanying drawings, which include various details of the embodiments of the present invention to facilitate understanding and should be considered as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted from the following description for clarity and conciseness.

[0045] In the introduction of the embodiments of the present invention, the definitions of some terms that appear are as follows:

[0046] Tenant: In the public cloud environment, it can be understood as a customer. Multi-tenancy is simply to realize the sharing of system instances among multiple tenants, and to ensure the isolation of data and resources of each tenant;

[00...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a job scheduling method and system, and relates to the technical field of computers. A specific implementation of the method includes: parsing the received trigger event into the input conditions of the job, and putting the job into the job set after all the input conditions of the job are ready; taking out the job to be dispatched from the job set and performing the job Dispatch; obtain job instance information from the dispatched job queue and execute the job. This implementation can avoid the common polling in the scheduling process and greatly improve the scheduling performance; the entire job scheduling is a "decentralized" design, which is executed by multiple individual components in series. The queue is decoupled, so that the system can be expanded by simply adding instances.

Description

technical field [0001] The present invention relates to the field of computer technology, and in particular, to a method and system for job scheduling. Background technique [0002] Job scheduling in a multi-tenant environment faces the following challenges: 1. With the increase of tenants, the number of daily running tasks can reach more than one million, and due to different business fields, there are complex tasks between jobs. Dependency, different jobs have different running frequency requirements, and even time zone differences; 2. Heterogeneous and diverse computing platforms (such as Hadoop platform, stream computing platform, massively parallel processing MPP platform, etc.), Heterogeneous platforms determine the complexity of scheduling job types, including script jobs such as Shell and Python, big data tasks such as Spark and Hive, and container tasks under the microservice framework. Third, complex resource management, many In a tenant environment, it is necessa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/54
CPCG06F9/546
Inventor 赖海滨洪少辉翁世清陈守当黄启成周怡臻林思远
Owner CHINA CONSTRUCTION BANK
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products