Method for predicting operation duration of batch processing task and related device

A long-running, batch-processing technology, applied in the field of data processing, can solve problems such as high manpower consumption costs, inconsistent prediction results, and low prediction accuracy, and achieve the effect of realizing operation monitoring and avoiding resource conflicts

Pending Publication Date: 2022-03-04
AGRICULTURAL BANK OF CHINA
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In related technologies, the running time of batch processing tasks is predicted by human experience, but this method is too dependent on human experience, the prediction accuracy is not high, different experiences may lead to inconsistent prediction results, and the cost of human consumption is high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for predicting operation duration of batch processing task and related device
  • Method for predicting operation duration of batch processing task and related device
  • Method for predicting operation duration of batch processing task and related device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0084] As a possible implementation manner, the prediction unit 202 is configured to:

[0085] Obtain the target impact factor model corresponding to the target job according to the type of the target job. Different types of jobs correspond to different impact factor models. The impact factors in the impact factor model include the daily online transaction volume coefficient and I / O throughput. coefficient, CPU resource coefficient and CF resource coefficient;

[0086] Predict the running time of the target job according to the daily online transaction volume, I / O throughput, CPU resources, CF resources, and the target impact factor model of the target job.

[0087] As a possible implementation manner, the prediction unit 202 is configured to:

[0088] Predict the running time of the target job according to the daytime online transaction volume, I / O throughput, CPU resources, CF resources, and memory usage of the target job.

[0089] As a possible implementation manner, the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a batch processing task running time prediction method and a related device, and the method comprises the steps: taking a batch node in a batch processing task as a target batch node, obtaining a job set executed by the target batch node, taking one job in the job set as a target job, and obtaining the target job; and obtaining the running duration of the target job according to the daytime online transaction volume, the I/O throughput, the CPU resource and the CF resource of the target job, obtaining the running duration of the target batch node according to the running duration of the target job, and obtaining the running duration of the batch processing task according to the running duration of the target batch node. Therefore, the operation duration of the job can be accurately predicted through the factors influencing the operation duration, including the daytime online transaction volume, the I/O throughput, the CPU resources and the CF resources, so that the operation duration of the batch nodes and the operation duration of the batch processing tasks are obtained, the operation monitoring of the batch processing tasks is realized, and the operation efficiency of the batch processing tasks is improved. Therefore, resource conflicts can be avoided in advance by increasing resources, pausing execution of some jobs and the like.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a method for predicting the running time of a batch processing task and a related device. Background technique [0002] During the operation and maintenance process of the mainframe system, the core system will perform batch processing through scheduled execution and batch execution when the business volume is small, such as the time period from 2:00 am to 4:00 am. A batch task consists of multiple batch nodes. A batch node is a complete set of job flow. A job flow includes multiple jobs. Multiple jobs may be executed serially or in parallel. Therefore, the running time of different batch nodes and even batch tasks may be different. [0003] If the running time of the current batch node is too long, it may affect the operation of the next batch node, it may affect the changes that need to be avoided during the batch execution period, and even affect the smooth op...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/30G06F11/34G06N3/08
CPCG06F11/3051G06F11/3419G06F11/3447G06N3/084
Inventor 叶文斌傅闪斌谈宏钟文时培军丁洁潘露萍
Owner AGRICULTURAL BANK OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap