Supercharge Your Innovation With Domain-Expert AI Agents!

Quartz-based distributed task scheduling system and method

A technology of distributed tasks and scheduling methods, applied in the field of quartz-based distributed task scheduling systems, can solve the problems of increasing application-side workload, task dispersion, complexity, etc., to reduce lock contention, reduce load, and improve throughput. Effect

Pending Publication Date: 2021-10-08
上海数禾信息科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this scheduling architecture requires master selection, which involves consistency issues such as failover. Real-time modification of concurrency limit, retry settings, alarm settings and other control plane controls

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Quartz-based distributed task scheduling system and method
  • Quartz-based distributed task scheduling system and method
  • Quartz-based distributed task scheduling system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0036] see figure 1 , the embodiment of the present invention provides a distributed task scheduling system based on quartz, which is integrated by a coordinator and a plurality of quartz service engines. The kernel of each quartz service engine includes a plurality of task management units, and the task management unit is preset with a first Load threshold; the coordinator is used to monitor the first load water level of the task management unit, and to dynamically expand the new task management unit when the first load water level of any task management unit reaches the first load threshold, wherein the new task management unit The configuration of the unit is the same as that of the task management unit whose first load water level reaches the first load threshold.

[0037] In the distributed task scheduling system based on quartz provided by the present invention, the kernel of each quartz service engine includes a plurality of task management units, and utilizes the coord...

Embodiment 2

[0043] see Figure 4 , the embodiment of the present invention provides a quartz-based distributed task scheduling method, including:

[0044] The first load threshold is preset to the task management unit in the quartz service engine, wherein the kernel of each quartz service engine includes a plurality of task management units, and the data of the task management unit in the quartz service engine is stored to the corresponding to the quartz service engine in the database;

[0045] Use the coordinator to monitor the first load level of the task management unit, and when the coordinator monitors that the first load level of any task management unit reaches the first load threshold, dynamically expand the new task management unit and make the new task management unit The configuration of the unit is the same as that of the task management unit whose first load water level reaches the first load threshold.

[0046] Wherein, when the coordinator monitors that the first load wat...

Embodiment 3

[0062] A computer-readable storage medium, having computer-readable program instructions stored thereon, the computer-readable program instructions are used to execute the quartz-based distributed task scheduling method in the second embodiment above, including: in the quartz service engine The task management unit presets the first load threshold, wherein the kernel of each quartz service engine includes a plurality of task management units, and the data of the task management unit in the quartz service engine is stored to correspond to the quartz service engine in the database; use the coordinator to monitor the first load level of the task management unit, and when the coordinator monitors that the first load level of any of the task management units reaches the first load threshold, dynamically expand the new a task management unit, and make the configuration of the new task management unit the same as that of the task management unit whose first load water level reaches th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a quartz-based distributed task scheduling system and method, and relates to the technical field of Internet. The system is integrated by a coordinator and a plurality of quartz service engines, the kernel of each quartz service engine comprises a plurality of task management units, and a first load threshold is preset for each task management unit; and the coordinator is used for monitoring the first load water level of the task management units and dynamically expanding a new task management unit when the first load water level of any task management unit reaches the first load threshold value. The quartz-based distributed task scheduling method is applied to the system, the load of a single task management unit is relieved by expanding the task management unit of the quartz, the task management units are not limited by the performance bottleneck problem of the quartz any more, and task routing can be controlled on a control plane while the workload of an application end is not increased.

Description

technical field [0001] The invention relates to the technical field of the Internet, in particular to a quartz-based distributed task scheduling system and method. Background technique [0002] The rapid development of the Internet has made the use of the Internet more and more common. The Internet has not only become a communication bridge within the enterprise, but also an important channel for various business transactions between the enterprise and the outside. Job scheduling is an indispensable existence in enterprise business processing. At present, most distributed task scheduling systems on the market are based on quartz as the kernel driver, combined with consul, zookeeper, etcd and other collaborative tools. There are two main scheduling architecture schemes in the scheduling system: [0003] The first is a centralized scheduling architecture, please refer to figure 1 , the core of which is to centralize the scheduler quartz, register the executor to the dispatch...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/50
CPCG06F9/5088G06F9/505Y02D10/00
Inventor 许鹏
Owner 上海数禾信息科技有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com