Data processing task dispatching system and method

A technology of data processing and task scheduling, applied in the field of data processing, can solve problems such as difficulty in locating error causes and error program locations, large task differences, and long time consumption, so as to shorten data processing time, ensure business logic, and improve usage efficiency effect

CN104407919AInactive Publication Date: 2015-03-11INSPUR SOFTWARE CO LTD
5 Cites 11 Cited by

Patent Information

Authority / Receiving Office
CN · China
Current Assignee / Owner
Publication Date
2015-03-11
Estimated Expiration
Not applicable · inactive patent

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
Patent Text Reader

Abstract

Provided is a data processing task dispatching system and a method thereof. The data processing task dispatching system comprises a task module, a task group module, a dispatching module, a log module, and a monitoring module; data processing requirements are firstly sent to the task module, the task module is interconnected with the task group module, the task group module is connected with the dispatching module and the monitoring module at the same time, the log module is connected with the dispatching module and the monitoring module at the same time. In a software application environment having a large batch background timed data processing tasks, the data processing task dispatching system and the method thereof achieve the unified dispatching, monitoring and controlling management of a series of data processing tasks by encapsulating tasks, designing the dispatching module and designing the monitoring module.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention belongs to the technical field of data processing, and in particular relates to a data processing task scheduling system and method. Background technique

[0002] In many software application scenarios, especially in data warehouse and data analysis software applications, there are often a large number of data processing requirements. This type of data processing requirements generally has the following characteristics: (1) This type of requirement generally needs to process a large amount of data, which takes a relatively long time and is not suitable for real-time data processing during user interaction. , so it is generally used as a background batch processing task to be started regularly and pre-processed; (2) This type of data processing requirements is generally closely related to time elements, so this type of data processing requirements generally need to be processed at a certain time interval (such as every year , monthly, wee...

Examples

Embodiment Construction

[0032] The specific implementation manners of the present invention will be described below in conjunction with the accompanying drawings.

[0033] Such as figure 1 As shown, a data processing task scheduling system of the present invention includes a task module, a task group module, a scheduling module, a log module, and a monitoring module. Data processing requirements are first sent to the task module, the task module and the task group module are connected to each other, and the task group The module is connected with the scheduling module and the monitoring module at the same time, and the log module is connected with the scheduling module and the monitoring module at the same time. The data processing requirements are first sent to the task module through task encapsulation, and the interconnection between the task module and the task group module is accomplished through arranging task sets, and the task group module is connected with the scheduling module and the monit...