Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Batch data scheduling method and system

A scheduling method and scheduling system technology, applied in the field of data processing, can solve the problems of unmeasured, difficult operation and maintenance, high time and labor costs, etc., and achieve the effects of flexible deployment and expansion, high batch execution efficiency, and improved efficiency

Inactive Publication Date: 2011-04-13
AGRICULTURAL BANK OF CHINA
View PDF4 Cites 31 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] 1. Most systems still run in host mode, and the system scalability is poor
It is difficult to flexibly control time cost and hardware cost, and it is impossible to solve the mutual constraints of time bottleneck and low resource utilization;
[0007] 2. The lack of a unified basic framework and the independent construction of batch systems between different projects have caused serious duplication of labor in the already complex infrastructure construction of the batch system. Develop new functional modules to complete;
[0008] 3. Operation and maintenance is difficult. A single operation and maintenance personnel can only be competent for the operation and maintenance of a batch system. Every time a new system is added, re-learning is often required, and the time and labor costs are too high;
The risks and costs brought about by this are immeasurable

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Batch data scheduling method and system
  • Batch data scheduling method and system
  • Batch data scheduling method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0050] The embodiment of the present invention provides a batch scheduling method for data processing, such as figure 1 Shown, is the step process of this method, and this method may comprise the following steps:

[0051] Step 101, the master control terminal obtains batch task data to be processed, and generates corresponding task scheduling instructions;

[0052] Step 102, the master control terminal sends the task scheduling instructions and corresponding task data to the intermediate server, and the intermediate server saves all the task scheduling instructions;

[0053] Step 103 , each application end in the application cluster accesses the intermediate server, obtains a corresponding task scheduling instruction, and executes processing of corresponding task data.

[0054]The implementation of data batch processing in the prior art is mainly based on the host mode, that is, all batch jobs run on a host or mainframe with excellent performance. Compared with the prior art...

Embodiment 2

[0063] Since each application end of the application cluster actively requests to obtain task scheduling instructions to execute corresponding task data, in order to further improve the efficiency of batch data processing, in another embodiment of the present invention, as figure 2 As shown, the method may include the following steps:

[0064] Step 201, the master control terminal obtains batch task data to be processed, and generates corresponding task scheduling instructions;

[0065] Step 202, the master control terminal sends the task scheduling instructions and corresponding task data to the intermediate server, and the intermediate server saves all the task scheduling instructions;

[0066] Step 203, each application terminal in the application cluster accesses the intermediate server, obtains a corresponding task scheduling instruction, and executes processing of corresponding task data;

[0067] Step 204: After the application end finishes processing the correspondin...

Embodiment 3

[0072] In order to facilitate the master control terminal to control all batch tasks, in another embodiment of the present invention, such as image 3 As shown in steps 303 and 304, in steps 203 and 204 in the above embodiment, after the application end completes the processing of the corresponding task data, it feeds back the result information to the intermediate server; the intermediate server sends the result information The information is uploaded to the master control terminal, which records in real time.

[0073] In the embodiment of the present invention, each application end feeds back the result information to the intermediate server after completing the corresponding task data processing. The result information here may include the result of the application executing the corresponding task, which may include: feedback on the correct execution of the task and feedback on the wrong execution of the task. The embodiment of the present invention does not specifically li...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a batch data scheduling method and system. The method comprises the following steps: acquiring batch task data to be processed by a master control end and generating a corresponding task scheduling instruction; sending the task scheduling construction and the corresponding task data by the master control end to an intermediate server, and saving all task scheduling instructions in the intermediate server; and visiting the intermediate server by each application end in an application cluster to acquire the corresponding task scheduling instructions, and executing processing of the corresponding task data. In the invention, the data required to be subject to batch processing is shared by a plurality of application ends, thereby greatly improving the efficiency of batch data processing.

Description

technical field [0001] The present invention relates to the technical field of data processing, and more specifically, to a batch scheduling method and system for data processing. Background technique [0002] Batch jobs (or batch programs) generally refer to batch programs with large data volumes that run in the background and do not require interaction with users. Batch scheduling is a general term for organizing a series of batch jobs according to a predefined execution order, handing them over to hardware resources to run, and managing the entire job running process. [0003] In the information systems of many large and medium-sized enterprises, especially in the fields of finance and telecommunications, there are a large number of complex business requirements for automated batch processing. A significantly greater variety of tasks has replaced earlier batch jobs, and the size and complexity of jobs continues to rise. Facing the needs of the rapid development of enter...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/46
Inventor 牛志嘉刘旭温良
Owner AGRICULTURAL BANK OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com