Task scheduling method based on distributed scheduling system, server and memory medium

A task scheduling and scheduling system technology, applied in the computer field, can solve problems such as preemption and thread waiting for resources, and achieve the effect of improving processing capacity

Inactive Publication Date: 2018-11-06
KANG JIAN INFORMATION TECH (SHENZHEN) CO LTD
View PDF0 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The existing distributed scheduling system implements task scheduling based on the database. The nodes executing the tasks in the system write the relevant information of the tasks into the database one by one. The scheduler of each node abides by an operation rule based on database locks to ensure the uniqueness of the operation.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Task scheduling method based on distributed scheduling system, server and memory medium
  • Task scheduling method based on distributed scheduling system, server and memory medium
  • Task scheduling method based on distributed scheduling system, server and memory medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0033] Such as figure 1 As shown, it is a schematic diagram of the application environment of the task scheduling method based on the distributed scheduling system of the present invention.

[0034] In this embodiment, the present invention provides a distributed scheduling system, which includes a scheduling engine, a load balancing device, a console, a database, and the like. Wherein, the scheduling engine is used to create timed tasks in batches according to the received task requests, and trigger task scheduling, and can also be used to perform management operations such as modification, deletion, suspension and recovery of tasks. The load balancing device is used to send the timed tasks obtained from the message queue to the host in a preset manner, and can also be used to monitor the execution status of all tim...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a task scheduling method based on a distributed scheduling system, a server and a memory medium. The method comprises the steps of receiving mass task scheduling requests, establishing timed tasks in batches according to the requests, and storing related information of each task to a message queue; receiving the tasks from the message queue, issuing each task to a corresponding host for performance according to a preset mode, and monitoring a performance state of each task in real time; automatically triggering the host which performs the task to reperform the task according to a preset task restart rule if certain task is performed unsuccessfully, writing performance state identification information to the task by a load balancing device if the task is still reperformed unsuccessful, forwarding the task to the other host for performance, until the task is performed successfully, and storing a task performance result to a database in a log form. Through application of the method, the server and the memory medium, the scheduling of mass distributed scheduling tasks can be realized, and the throughput of the distributed system is improved.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a task scheduling method based on a distributed scheduling system, a server and a computer-readable storage medium. Background technique [0002] In the Internet, cloud computing, and big data era, task processing has the characteristics of big data and high concurrency. The main purpose of the distributed task scheduling system is to avoid repeated processing of data when coordinating multiple nodes to process the same task. The nodes of the cluster share the processing of large batches of tasks to improve the processing efficiency of batch tasks. [0003] The existing distributed scheduling system implements task scheduling based on the database. The nodes executing the tasks in the system write the relevant information of the tasks into the database one by one. The scheduler of each node abides by an operation rule based on database locks to ensure the uniqueness of the ope...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/50
CPCG06F9/5038G06F9/505G06F2209/5017
Inventor 孙志博
Owner KANG JIAN INFORMATION TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products