Check patentability & draft patents in minutes with Patsnap Eureka AI!

Distributed high-availability task scheduling method and system

A task scheduling and distributed technology, applied in resource allocation, program startup/switching, inter-program communication, etc., can solve the problems of limited utilization of distributed resources, low processing performance, coarse data granularity, etc., to improve processing efficiency and The effect of fault handling capability, cost reduction, and complete scheduling strategy

Pending Publication Date: 2021-03-19
浙江百应科技有限公司
View PDF11 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] Most companies use some current open source scheduling tools when using scheduling tasks. It is necessary to introduce related jar packages, add configuration files, and develop corresponding codes. This is time-consuming, labor-intensive, and costly; The popular scheduling method basically distributes distributed nodes based on tasks. If a distributed node fails or a certain task is abnormal, the task batch will fail, and the scope of influence is relatively large;
[0003] The current scheduling scheme has limited utilization of distributed resources, coarse data granularity, fails to make full use of distributed resources, and has low processing performance.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed high-availability task scheduling method and system
  • Distributed high-availability task scheduling method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0040] refer to figure 1 , the present embodiment relates to a distributed high-availability task scheduling method, which includes the following steps:

[0041] (1) The thread manager calculates and allocates the number of scheduling task threads according to the number of dispatching tasks configured by the dispatching center and the historical execution of this task, and starts the isolation thread pool;

[0042] (2) The coordinating processor obtains a thread from the thread pool and obtains task data units in batches through the exposed task data unit batch acquisition interface, and sends them to the task distributor;

[0043] (3) The task dispatcher sends the task data unit to the task dispatcher placement queue on the principle of first in first out;

[0044] (4) The task distributor dynamically distributes execution tasks to the coordinating processor according to the scheduling strategy and the processing capabilities of each node;

[0045] (5) The coordinating pro...

Embodiment 2

[0054] refer to figure 2 , the present embodiment relates to a distributed high-availability task scheduling system, which includes a scheduling center system 1, a business system 2 and a zookeeper cluster 3;

[0055] The dispatch center system 1 includes a task issuer 11, a coordinating processor 12, a thread manager 13 and a task analyzer 14;

[0056] The business system 2 includes a plurality of business processing modules, and the business processing module obtains the task data unit to be processed from the dispatching center system 1 by exposing the task data unit processing interface and executes the task data unit;

[0057] The zookeeper cluster 3 is used to store the files in the dispatch center system 1 to ensure the consistency of task data in the dispatch center system;

[0058] Thread manager 13 is used to configure the scheduling task number, calculates and distributes the scheduling task thread number and starts the isolation thread pool;

[0059] The coordin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed high-availability task scheduling method and system, and the method comprises the steps: obtaining task configuration, calculating an allocation thread, obtainingtask data units in batches, transmitting the task data units to a task distributor placement queue, calculating a data unit distribution strategy, distributing an execution task, and transmitting thedata units for processing; and sending a processing result and summarizing and analyzing an alarm strategy. According to the method, the scheduling tasks are refined to the task data units, the taskdata units are isolated from one another, the task data units are used for distribution processing in a distributed environment, the processing efficiency and the fault processing capacity of the scheduling tasks are greatly improved, and a retry strategy can be carried out according to the situation of failed tasks.

Description

technical field [0001] The invention belongs to the technical field of online service task scheduling, and in particular relates to a distributed high-availability task scheduling method and system. Background technique [0002] Most companies use some current open source scheduling tools when using scheduling tasks. It is necessary to introduce related jar packages, add configuration files, and develop corresponding codes. This is time-consuming, labor-intensive, and costly; The popular scheduling method basically distributes distributed nodes based on tasks. If a distributed node fails or a certain task is abnormal, the task batch will fail, and the scope of influence is relatively large; [0003] The current scheduling scheme has limited utilization of distributed resources, coarse data granularity, fails to make full use of distributed resources, and has low processing performance. Contents of the invention [0004] In view of this, the present invention proposes a di...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/48G06F9/50G06F9/54
CPCG06F9/485G06F9/5027G06F9/546G06F2209/5011G06F2209/5018G06F2209/548
Inventor 魏少龙
Owner 浙江百应科技有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com