Distributed task scheduling system

A technology for distributed tasks and task scheduling, applied in the field of distributed task scheduling systems, can solve problems such as the inability to concurrently run a large number of tasks, the burden of machines, and the limited number of tasks running at the same time. , the effect of increasing concurrency and solving performance bottlenecks

Active Publication Date: 2020-03-20
BEIJING QIHOO TECH CO LTD
View PDF11 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] It can be seen that in the task running mode of the prior art, the number of tasks that can be run at the same time is limited by the system capacity of the machine, and a large number of tasks cannot be concurrently executed at the same time. Task
Moreover, since the calculation process of ea

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed task scheduling system
  • Distributed task scheduling system
  • Distributed task scheduling system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0017] figure 1 A schematic structural diagram of a distributed task scheduling system provided by Embodiment 1 of the present invention is shown. Wherein, the distributed task scheduling system includes: a front-end interaction module 11, a task scheduling module 12, a plurality of distributed task execution modules 13 (only one is shown in the figure), and a computing engine module 14; wherein, the front-end interaction module 11 , for sending a task interaction request to the task scheduling module 12 according to the received task interaction operation related to the task, and receiving the task interaction result returned by the task scheduling module 12; The task interaction request sent by 11 determines each task to be executed, and distributes each task to be executed to the task execution module 13; the task execution module 13 is used to execute the task distributed by the task scheduling module, and sends the task to the task The scheduling module returns the task ...

Embodiment 2

[0021] figure 2 A schematic flowchart of a task recovery method provided by Embodiment 2 of the present invention is shown. Preferably, the task recovery method is applied to the distributed task scheduling system in Embodiment 1 of the present invention. Of course, those skilled in the art can know that the task recovery method can also be applied to other forms of systems or devices, and the present invention does not limit the application scenarios of the task recovery method.

[0022] In order to facilitate understanding, it is described by taking the application of the task recovery method to the distributed task scheduling system in Embodiment 1 as an example. Such as figure 2 As shown, the task recovery method includes the following steps:

[0023] Step S210: Create a metadata file corresponding to the task for a successfully started task, and record task-related information of the task through the metadata file corresponding to the task during the running process ...

example 1

[0034] The local task recovery method is mainly used for task recovery locally in each task execution module, and each task execution module is responsible for the recovery operation of each task inside the module. This method has many advantages such as fast transmission speed and convenient operation.

[0035] Specifically, when the local task recovery method is adopted, step S210 is specifically: when creating a metadata file corresponding to the task for a successfully started task, in the local storage space of the task execution module used to run the successfully started task Create a metadata file corresponding to the task. That is to say, each task execution module creates a metadata file corresponding to the task in the local storage space of this module for the task in this module. The metadata file can only be accessed by this module, and other task execution modules No access without authorization.

[0036] Correspondingly, step S220 is specifically: the task exe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed task scheduling system. The system comprises a database for storing task information of a to-be-executed task, a plurality of task scheduling modules and a plurality of task execution modules, wherein the task scheduling modules are suitable for judging whether a task scheduling message to be issued to the task execution module belongs to a message of a presettype; if yes, issuing the task scheduling message to a task execution module according to a preset consistency strategy; the task execution modules are suitable for executing a corresponding task according to the received task scheduling message and returning a task response message to the task scheduling module; wherein the message of the preset type comprises a message which needs to access task information stored in the database in a message generation process. Through the consistency strategy, the problem of data inconsistency caused by the fact that multiple task scheduling modules access the database at the same time can be prevented, and the service stability is improved.

Description

technical field [0001] The invention relates to the technical field of computers, in particular to a distributed task scheduling system. Background technique [0002] At present, with the rapid development of the Internet, there are more and more types of tasks that need to be performed on the network. In the traditional task operation mode, a single machine is mostly responsible for running multiple tasks, and the calculation process of each task also needs to be completed by this machine. [0003] It can be seen that, in the task running mode of the prior art, the number of tasks that can be run at the same time is limited by the system capacity of the machine, and a large number of tasks cannot be concurrently executed. Moreover, since the calculation process of each task also needs to be completed by this machine, it has caused a huge burden on the machine itself, especially when there are various types of tasks, a machine is responsible for completing the calculation p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/48
CPCG06F9/4881
Inventor 李铮朱俊刘彤
Owner BEIJING QIHOO TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap