Distributed task system, management method, device and computer equipment

A distributed task and management method technology, applied in the field of distributed task processing, can solve the problems of responsible task execution status and execution results, failure to guarantee normal execution of scheduled tasks, poor stability of scheduled task execution, etc.

Pending Publication Date: 2021-02-26
SHANGHAI BILIBILI TECH CO LTD
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the timing task manager crontab is simple and easy to use, the inventor found that it cannot guarantee the normal execution of the timing task, which makes the execution stability of the timing task poor. Tasks are not responsible for the execution status and execution r

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed task system, management method, device and computer equipment
  • Distributed task system, management method, device and computer equipment
  • Distributed task system, management method, device and computer equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] An embodiment of the present invention provides a distributed task management method. The execution subject of the method is the master node in the distributed task system. The distributed task system includes the master node, and also includes a working node and a management node, wherein the management node It is used to store the task status of the scheduled task, and the working node is used to execute the scheduled task and modify the task status according to the execution status of the scheduled task. Through this method, the execution stability of the scheduled task can be improved. Specifically, the distributed The task management method includes steps S103 to S106 as follows.

[0031] Step S103: Query whether there is a first task in the task message queue.

[0032] Wherein, the task message queue includes scheduled tasks to be executed, and the first task is the scheduled task that meets the execution time requirement.

[0033] Specifically, the task message ...

Embodiment 2

[0075] Corresponding to the first embodiment above, the second embodiment of the present invention provides a distributed task management device, the device is set on the master node in the distributed task system, the distributed task system includes the master node, and also includes working nodes and management Nodes, wherein the management node is used to store the task status of the scheduled task, and the working node is used to execute the scheduled task and modify the task status according to the execution status of the scheduled task. Through this device, the execution stability of the scheduled task can be improved. For details of corresponding technical features and technical effects, reference may be made to the first embodiment above, which will not be repeated in this embodiment. figure 2 A block diagram of a distributed task management device provided in Embodiment 2 of the present invention, such as figure 2 As shown, the distributed task management device in...

Embodiment 3

[0083] Embodiment 3 of the present invention provides a distributed task system, image 3 The block diagram of the distributed task system provided for Embodiment 3 of the present invention, such as image 3 As shown, the distributed task system includes a master node 301, a work node 302 and a management node 303, wherein the management node 303 is used to store the task state of the timed task; the work node 302 is used to execute the timed task and according to the execution state of the timed task Modify the task state; the master node 301 is used to execute any distributed task management method provided in the first embodiment of the present invention, or the master node 301 includes any distributed task management device provided in the second embodiment of the present invention, the specific technology For details, reference may be made to the first and second embodiments above, and details are not repeated here.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a distributed task system, a management method, a device and computer equipment. The distributed task system comprises a main node, a working node and a management node, the management node is used for storing the task state of a timing task, and the working node is used for executing the timing task and modifying the task state according to the execution state of the timingtask; wherein an execution main body of the distributed task management method is a main node, and the distributed task management method comprises the steps that whether a first task exists in a task message queue or not is inquired, the task message queue comprises a to-be-executed timing task, and the first task is a timing task meeting the execution time requirement; when the task message queue has the first task, distributing the first task to a first working node; obtaining a task state of the first task from a management node; and managing the first task according to the obtained taskstate of the first task. According to the invention, the stability of the timing task can be improved.

Description

technical field [0001] The invention relates to the technical field of distributed task processing, in particular to a distributed task system, management method, device and computer equipment. Background technique [0002] At present, in Internet scenarios of various business types, there are a large number of various scheduled tasks that need to be executed every day, including scheduled statistical tasks and scheduled data pull tasks. For example, the regular settlement system needs to settle the user consumption data and commodity sales statistics data of the previous day after midnight every day; the report system needs to aggregate data regularly, obtain the data aggregation results on specific dimensions regularly, and display the data dynamically over time trend. It will involve some data synchronization tasks, regularly pull data, and then transfer to the designated data storage tool. [0003] In the prior art, the regular task manager crontab is usually used to m...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/48G06F9/50G06Q30/02
CPCG06F9/485G06F9/5072G06Q30/0201
Inventor 任运宜
Owner SHANGHAI BILIBILI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap