Distributed job scheduling method

A job scheduling and distributed technology, applied in resource allocation, program startup/switching, program control design, etc., can solve problems such as job level expansion and sacrifice, and achieve the effect of good efficiency and performance, and high task efficiency

Pending Publication Date: 2020-01-14
SICHUAN XW BANK CO LTD
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] In view of the above-mentioned research problems, the purpose of the present invention is to provide a distributed job scheduling method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed job scheduling method
  • Distributed job scheduling method

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0057] Example

[0058] The job configuration is stored in the MySQL database, and the operation mode of the job is job fragmentation, that is, the job fragmentation is stored in the memory of the server running the job.

[0059] In the application scenario of dependent jobs in the financial field, configure 4 jobs A, B1, B2, and C, and the number of shards for each job is 2, B1, B2, and C are configured with the corresponding job names of the dependent jobs, as follows ;

[0060] Job A: Triggered once a day, no dependent job;

[0061] Job B1: It is triggered once per second and depends on job A, that is, both job fragments depend on A;

[0062] Job B2: It is triggered once per second and depends on job A, that is, both job fragments depend on A;

[0063] Job C: It is triggered once per second and depends on jobs B1 and B2, that is, both job fragments depend on B1 and B2;

[0064] After all jobs (that is, JAVA dependent jobs A, B1, B2, and C) are enabled, all other jobs except the initia...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed job scheduling method, belongs to the technical field of job scheduling under a distributed task scheduling framework, and solves the problem that horizontal capacity expansion of jobs is sacrificed due to the fact that only one fragment exists in dependent jobs in the prior art. The method comprises the following steps: fragmenting each job according to an application scene to obtain job fragments; wherein each job has a field used for describing dependent jobs of the job, if the job is not an initial job, related information of the dependent jobs is configured in the fields, all JAVA dependent jobs are obtained after configuration, and all the JAVA dependent jobs comprise the initial job and the JAVA dependent jobs configured with the fields; and based on the job fragments and all JAVA dependent jobs, periodically triggering each JAVA dependent job to execute logic judgment, and executing or not executing the jobs according to a judgment result until all jobs in the whole process are normally completed. The method is used for distributed job scheduling.

Description

technical field [0001] A distributed job scheduling method is used for distributed job scheduling and belongs to the technical field of job scheduling under the framework of distributed task scheduling. Background technique [0002] In the prior art, scheduled tasks are managed and scheduled through a cluster, and distributed deployment is adopted to ensure high availability of the system and improve fault tolerance. This is what a distributed job scheduling platform can achieve. [0003] In the prior art, Saturn 3.3.0 already has its own dependent job implementation, and its implementation scheme is as follows: [0004] 1) Whether the job is executed is judged by the immediate execution detection of the worker corresponding to the job once per second. [0005] 2) Selection of job type: Job scheduling is an orderly and acyclic process, so the first job and other jobs are two job types (the first job is a JAVA / SHELL scheduled job, and the other jobs are JAVA / SHELL dependent...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4843G06F9/5061Y02D10/00
Inventor 谢延泽李佳明周勇
Owner SICHUAN XW BANK CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products