Batch processing job verification method, device, equipment and medium

Through the combination of import, analysis and verification modules, automated verification of batch jobs is realized, solving the problem of low verification efficiency caused by data dispersion, and improving verification efficiency and accuracy.

CN112416727BActive Publication Date: 2024-11-26CHINA CONSTRUCTION BANK
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202011322642.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-11-23
Publication Date
2024-11-26
Estimated Expiration
2040-11-23

AI Technical Summary

Technical Problem

The large amount of execution data generated after batch job execution is distributed and difficult to collect, analyze and verify, resulting in low verification efficiency and affecting performance optimization.

Method used

Provide a batch job inspection method, collect relevant information by importing modules, analyze the analysis module for data analysis, and check the result of the inspection module to realize automated inspection and improve the inspection efficiency.

Benefits of technology

It realizes automated inspection of batch operations, improves inspection efficiency, avoids incomplete or inaccurate inspection caused by personnel negligence, and simplifies the data collection and analysis process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112416727B_ABST
    Figure CN112416727B_ABST
Patent Text Reader

Abstract

The embodiment of the present invention discloses a batch job verification method, device, equipment and medium. The method comprises: collecting at least one information related to the operation of the target batch job through an import module; performing data analysis on the operation of the target batch job according to the at least one information through an analysis module; and verifying the operation result of the target batch job according to the at least one information through a verification module. The above technical solution realizes the automation of batch job verification and improves the verification efficiency.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of data processing technology, and in particular to a batch job verification method, device, equipment and medium. Background Art

[0002] In order to meet some of the bank's service functions, it is often necessary to develop different job instances, then string these jobs together into a job execution sequence, and initiate a whole batch of tests through a job scheduling tool. The job execution results need to be checked based on the business scenarios and business functions of the jobs.

[0003] The non-functional optimization phase of batch processing often requires a large number of functional point comparison tests, such as optimization tests for jobs with long execution time, optimization tests for high-frequency task splitting, optimization tests for database query, and optimization tests for down-file clearing performance. After the batch processing job is finished, a large amount of execution data will be generated, but these data are relatively scattered, which is not convenient for development and operation personnel to collect, analyze and check. Manual operations are complicated and not conducive to providing data support for the optimization of batch processing job execution performance. Summary of the invention

[0004] The embodiments of the present invention provide a batch job verification method, device, equipment and medium to realize the automation of batch job verification and improve verification efficiency.

[0005] In a first aspect, an embodiment of the present invention provides a batch job verification method, comprising:

[0006] collecting at least one type of information related to the running of the target batch processing job through the import module;

[0007] Performing data analysis on the operation status of the target batch processing job according to the at least one information through an analysis module;

[0008] The running result of the target batch processing job is checked according to the at least one information by a checking module.

[0009] In a second aspect, an embodiment of the present invention further provides a batch processing job verification device, comprising:

[0010] An import module for collecting at least one type of information related to the running of a target batch job;

[0011] An analysis module, configured to perform data analysis on the operation status of the target batch processing job according to the at least one information;

[0012] A checking module is used to check the running result of the target batch processing job according to the at least one information.

[0013] In a third aspect, an embodiment of the present invention further provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the batch job verification method as described in any embodiment of the present invention is implemented.

[0014] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the batch job checking method as described in any embodiment of the present invention.

[0015] The technical solution provided by the embodiment of the present invention collects at least one kind of information related to the operation of the target batch processing job through an import module, performs data analysis on the operation status of the target batch processing job according to the at least one kind of information through an analysis module, and verifies the operation result of the target batch processing job according to the at least one kind of information through a verification module, thereby realizing the automation of batch processing job verification and improving verification efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 It is a structural schematic diagram of a batch processing job verification system in the first embodiment of the present invention;

[0017] Figure 2 It is a flow chart of a batch processing job verification method in Embodiment 2 of the present invention;

[0018] Figure 3 It is a structural schematic diagram of a batch processing job verification device in Embodiment 4 of the present invention;

[0019] Figure 4 It is a schematic diagram of the hardware structure of a computer device in Embodiment 5 of the present invention. DETAILED DESCRIPTION

[0020] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only parts related to the present invention, rather than all structures, are shown in the accompanying drawings.

[0021] It should be mentioned before discussing the exemplary embodiments in more detail that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow charts describe the operations (or steps) as sequential processes, many of the operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of the operations can be rearranged. The process can be terminated when its operation is completed, but can also have additional steps not included in the accompanying drawings. The process can correspond to a method, function, procedure, subroutine, subprogram, etc.

[0022] Embodiment 1

[0023] Figure 1 1 is a schematic diagram of a batch job verification system provided by the first embodiment of the present invention, which can be applied to data collection, analysis and verification of batch job operation results. Figure 1 As shown, the batch processing job verification system provided in this embodiment specifically includes: an import module 110, an analysis module 120 and a verification module 130. Among them,

[0024] The import module 110 is a batch job running status information collection tool, which is used to collect at least one information related to the target batch job running; the analysis module 120 is used to perform data analysis on the running status of the target batch job based on the at least one information; the verification module 130 is used to verify the running result of the target batch job based on the at least one information.

[0025] The target batch job refers to any batch job in the batch processing environment.

[0026] The import module 110 is used to collect the running results of the target batch processing job, and specifically needs to collect data for the information of each job, such as job step information, offset information, file information, calling program, etc.

[0027] In an optional implementation, the import module collects at least the scheduling information of the target batch processing job, the job result data of the target batch processing job, the file information related to the target batch processing job, and the related information in the server executing the target batch processing job.

[0028] Optionally, the import module 110 accesses a scheduling tool, a NAS (Network Attached Storage), a database (such as a relational database), and a server to obtain various information related to the execution of the target batch job.

[0029] Among them, the import module accesses the scheduling tool to collect scheduling information about the target batch job (such as the before and after relationship of job execution), etc. Specifically, the scheduling report output by the scheduling tool can be read to collect relevant scheduling information; the import module accesses NAS to collect file information related to the target batch job operation, such as file name, number of files, number of records in the file, file width and other information; the import module can access the database to collect the job result data of the batch job stored in the database; the import module can access the server to collect relevant information, such as job operation information and server system information.

[0030] The server executing the target batch job may include an AP (Application) server and a high-frequency server, etc. The AP server is used to implement the execution of the target batch job, and the high-frequency server is used to implement the concurrency and load balancing of tasks within the target batch job. The collection of server load information (such as CPU and memory usage) during the execution of the batch job is also very important for the analysis of the batch job operation results, providing powerful data analysis for subsequent developers to optimize performance.

[0031] By simply providing basic information of the target batch job, the import module 110 can obtain relevant operation information of the target batch job and store the collected information in a local database. When the analysis module 120 performs batch job operation result data analysis and the verification module 130 performs batch job operation result verification, there is no need to collect information for each job separately, and access to the local database is sufficient.

[0032] The analysis module 120 is used to implement data analysis of the target batch processing job running results, such as analyzing the long-time jobs in the target batch processing job, the critical path of the target batch processing job, the efficiency ratio of the target batch processing job, the processing status of the target batch processing job, and the task concurrency and load balancing status of the target batch processing job.

[0033] Among them, the critical path of the target batch job refers to the longest job execution sequence from the start of the first job to the completion of the last job when the target batch job is running, which can be obtained from the job running information during the target batch job running period. The critical path is the job execution sequence that determines the total running time of the batch job. The optimization of the critical path is conducive to improving the running speed of the batch job.

[0034] The efficiency ratio of the target batch job refers to the ratio between the number of files running and the running time of the target batch job. The vertical comparison of the efficiency ratios of batch jobs (that is, comparing the efficiency ratios of batch jobs of different batches) is helpful to analyze the optimization status of individual jobs and batch jobs.

[0035] The verification module 130 is used to verify the target batch job running results, which can generally include database result verification and file result verification. Specifically, the batch job running results can be verified based on the business scenario and business function scope of the batch job. For example, the file processing status corresponding to the target batch job can be verified, the file clearing and downloading status corresponding to the target batch job can be verified, the file transfer status corresponding to the target batch job can be verified, and the copy synchronization status corresponding to the target batch job can be verified.

[0036] Optionally, the checking module 130 checks the file processing status corresponding to the target batch processing job based on the relevant information in the server executing the target batch processing job and the file information related to the target batch processing job.

[0037] Among them, the relevant information in the server that executes the target batch processing job refers to the job running information. First, the basic job information and job running step information of the target batch processing job can be analyzed according to the job running information of the target batch processing job, and then the file processing status corresponding to the target batch processing job can be checked based on the basic job information, job running step information and file information related to the target batch processing job.

[0038] The basic information of a job refers to information such as job definition and program definition, etc. The information of a job running step refers to information such as job content and job steps, etc. Both the basic information of a job and the information of a job running step can be obtained by parsing the JAR package corresponding to the target batch job running in the server, wherein each job step exists in the JAR package in the XML format.

[0039] For example, the verification module checks whether the file is processed correctly based on the file offset information and upstream file information in the job configuration.

[0040] Optionally, the verification module 130 verifies the clearing and downloading of files corresponding to the target batch processing job based on the job result data of the target batch processing job and the file information related to the target batch processing job. Downloading refers to writing the information in the database into the file, and clearing refers to deleting the corresponding information in the database. For example, the verification module compares the database data information and file information before and after the target batch processing job is run, and determines whether the corresponding file for downloading is correct and whether the corresponding data for clearing is cleared.

[0041] Optionally, before the target batch job runs, the database and NAS are accessed through an import tool to obtain database data information and file information before and after the target batch job runs. After the target batch job runs, it can be determined whether the corresponding files for downloading are correct and whether the corresponding data for clearing files is cleared.

[0042] Optionally, the checking module 130 checks the file transmission status corresponding to the target batch processing job based on the job result data of the target batch processing job and the file information related to the target batch processing job. For example, the checking module checks whether the file transmission is correct according to the file transmission configuration information, the control file and the job step return value.

[0043] Optionally, the checking module 130 is also used to check the synchronization of the replica corresponding to the target batch job. For example, the checking module checks whether the database operation after replica synchronization is correct based on the upstream replica information and the database data information before the target batch job is run.

[0044] The technical solution provided by the embodiment of the present invention collects at least one kind of information related to the operation of the target batch processing job through an import module, performs data analysis on the operation status of the target batch processing job according to the at least one kind of information through an analysis module, and verifies the operation result of the target batch processing job according to the at least one kind of information through a verification module, thereby realizing the automation of batch processing job verification, improving verification efficiency, and also avoiding the problem of incomplete or inaccurate verification caused by human negligence.

[0045] The batch job verification system provided by the embodiment of the present invention does not affect the existing batch job operation process. It only needs to provide a small amount of configuration parameters for accessing data sources (such as scheduling tools, NAS, databases, and servers, etc.) to achieve automatic verification of batch job operations across platform components.

[0046] Embodiment 2

[0047] Figure 2 It is a flow chart of a batch job verification method provided in the second embodiment of the present invention, which can be applied to the situation of collecting, analyzing and verifying the data of the batch job running results. The method can be executed by the batch job verification device provided in the embodiment of the present invention, which can be implemented in software and / or hardware and can generally be integrated in a computer device.

[0048] like Figure 2 As shown, the batch processing job verification method provided in this embodiment specifically includes:

[0049] S210. Collect at least one kind of information related to the running of the target batch processing job through an import module.

[0050] The target batch job refers to any batch job in the batch processing environment.

[0051] Optionally, collecting at least one information related to the operation of the target batch processing job through the import module can be specifically: collecting at least scheduling information related to the target batch processing job, job result data of the target batch processing job, file information related to the target batch processing job, and relevant information in the server executing the target batch processing job through the import module.

[0052] Among them, scheduling information refers to the dependencies before and after job execution; the relevant information in the server refers to job running information and server system information. Job running information refers to information related to batch job running, such as job definition, program definition, job steps, etc. Server system information refers to server CPU, memory information, etc.

[0053] The import module accesses the scheduling tool, NAS, database, and server to obtain various information related to the operation of the target batch job, such as the scheduling information of the target batch job, job result data, file information related to the target batch job, and related information in the server executing the target batch job.

[0054] Optionally, the import module accesses the scheduling tool to collect scheduling information about the target batch job (such as the before and after relationship of job execution), etc. Specifically, the scheduling report output by the scheduling tool can be read to collect relevant scheduling information; the import module accesses NAS to collect file information related to the target batch job operation, such as file name, number of files, number of records in a file, file width and other information; the import module can access the database to collect job result data of the batch job stored in the database; the import module can access the server to collect relevant information, such as job operation information and server system information.

[0055] S220: Perform data analysis on the running status of the target batch processing job according to at least one information related to the running of the target batch processing job through the analysis module.

[0056] The analysis module is used to analyze the operation status of the target batch job based on the data related to the operation of the target batch job collected by the import module, such as analyzing the long-time jobs in the target batch job, the critical path of the target batch job, the efficiency ratio of the target batch job, the processing status of the target batch job, and the task concurrency and load balancing of the target batch job.

[0057] Among them, the data analysis on the operation of the target batch processing job can be divided into static analysis and dynamic analysis. Static analysis refers to the analysis of the scheduling information of the target batch processing job collected by the import tool accessing the scheduling tool; dynamic analysis refers to the analysis of the information related to the operation of the target batch processing job collected by the import tool accessing the NAS, database, and server.

[0058] Optionally, the analysis module outputs data analysis results for the running status of the target batch processing job, for example, the analysis results may be output in the form of a data analysis report.

[0059] S230: Verify the running result of the target batch processing job according to at least one information related to the running of the target batch processing job through a verification module.

[0060] The verification module is used to verify the target batch job operation results based on the data collected by the import module, such as job step operation information, NAS file information, database information, etc. For example, the correctness of the offset during file processing, the accuracy of database clearing and downloading, the correctness of file transfer, and the correctness of replica synchronization database operations.

[0061] Optionally, the verification module outputs a verification result of the running result of the target batch processing job, for example, the verification result may be output in the form of a verification report.

[0062] For details not explained in this embodiment, please refer to the aforementioned embodiments and will not be repeated here.

[0063] The technical solution provided by the embodiment of the present invention collects at least one kind of information related to the operation of the target batch processing job through an import module, performs data analysis on the operation status of the target batch processing job according to the at least one kind of information through an analysis module, and verifies the operation result of the target batch processing job according to the at least one kind of information through a verification module, thereby realizing the automation of batch processing job verification, improving verification efficiency, and also avoiding the problem of incomplete or inaccurate verification caused by human negligence.

[0064] Embodiment 3

[0065] Based on the above-mentioned embodiments, this embodiment provides several specific implementations of the analysis module performing data analysis on the target batch processing job running results, and several specific implementations of the verification module performing verification on the target batch processing job running results.

[0066] In an optional embodiment, referring to Figure 1 , performing data analysis on the running status of the target batch processing job according to the at least one information through the analysis module, which can be specifically as follows:

[0067] The analysis module analyzes the basic job information of the target batch processing job based on the relevant information in the server executing the target batch processing job.

[0068] In this embodiment, the relevant information in the server executing the target batch job refers to the job running information in the server, which exists in the form of a JAR package. The basic job information refers to information such as job definition and program definition.

[0069] The analysis module parses the job running information in the form of a JAR package corresponding to the target batch processing job in the server collected by the import module to obtain basic job information of the target batch processing job.

[0070] Optionally, the analysis module analyzes the upstream and downstream relationships of files between jobs, the accuracy of job file processing, and step running calling program parameters based on the parsed job step information, calling program, step file processing information, etc.

[0071] In an optional embodiment, referring to Figure 1 , performing data analysis on the running status of the target batch processing job according to the at least one information through the analysis module, which can be specifically as follows:

[0072] The job step running information of the target batch processing job is analyzed by the analysis module based on the relevant information in the server executing the target batch processing job.

[0073] In this embodiment, the relevant information in the server executing the target batch job refers to the job running information in the server, which exists in the form of a JAR package. The job running step information refers to information such as job content and job steps, which exists in the JAR package in XML format.

[0074] The analysis module parses the job running information in the form of a JAR package corresponding to the target batch processing job in the server collected by the import module to obtain the job step running information of the target batch processing job.

[0075] Optionally, the analysis module analyzes the specific running status of the long-term job based on the parsed information such as the job running time, step running time, and number of file records.

[0076] In an optional embodiment, referring to Figure 1 , the analysis module performs data analysis on the operation status of the target batch processing job according to at least one information, which can be specifically:

[0077] The critical path of the target batch processing job is analyzed based on the scheduling information of the target batch processing job through the analysis module; wherein the critical path affects the total duration of the target batch processing job execution sequence running.

[0078] The critical path of the target batch job refers to the longest job execution sequence from the start of the first job to the completion of the last job when the target batch job is running. The critical path is the job execution sequence that determines the total running time of the batch job. The optimization of the critical path is conducive to improving the running speed of the batch job.

[0079] The analysis module analyzes the scheduling information of the target batch processing jobs collected by the import module, and analyzes the scheduling running time of each job to determine the critical path of the target batch processing job running.

[0080] In an optional embodiment, referring to Figure 1 , the analysis module performs data analysis on the operation status of the target batch processing job according to at least one information, which can be specifically:

[0081] The analysis module analyzes the operation efficiency of the target batch processing job based on the scheduling information of the target batch processing job and the file information related to the target batch processing job.

[0082] Optionally, the running efficiency of the target batch job is represented by an efficiency ratio. The efficiency ratio refers to the ratio between the number of files running and the running time of the target batch job. The vertical comparison of the efficiency ratios of batch jobs (i.e., comparing the efficiency ratios of batch jobs of different batches) is helpful for analyzing the optimization status of individual jobs and batch jobs.

[0083] The analysis module analyzes the scheduling information of the target batch job collected by the import module, calculates the job running time of the target batch job, analyzes the file information related to the target batch job, obtains the number of file records of the target batch job, and then calculates the ratio of the number of file records of the target batch job to the job running time as the efficiency ratio of the target batch job, so as to analyze the running efficiency of the target batch job.

[0084] Optionally, the analysis module compares the operating efficiency of the target batch processing job with the operating efficiency of a matching previous batch of batch processing jobs to analyze the operating efficiency of different batches of batch processing jobs.

[0085] In an optional embodiment, referring to Figure 1 , the analysis module performs data analysis on the operation status of the target batch processing job according to at least one information, which can be specifically:

[0086] The processing status of the target batch processing job is analyzed based on the relevant information in the server executing the target batch processing job through the analysis module.

[0087] In this implementation manner, the relevant information in the server executing the target batch job refers to server system information, and specifically may be system information of the AP server, such as CPU, memory information, and the like.

[0088] The analysis module analyzes the processing speed of the target batch job based on the CPU and memory usage of the AP server in each time period collected by the import module.

[0089] In an optional embodiment, referring to Figure 1 , the analysis module performs data analysis on the operation status of the target batch processing job according to at least one information, which can be specifically:

[0090] The analysis module analyzes the task concurrency and load balancing conditions corresponding to the target batch processing job based on the relevant information in the server executing the target batch processing job.

[0091] In this implementation manner, the relevant information in the server executing the target batch processing job refers to server system information, and specifically may be system information of a high-frequency server, such as CPU, memory information, and the like.

[0092] The analysis module analyzes the concurrent execution and load balancing of tasks in the target batch job based on the CPU and memory usage of high-frequency servers in each time period collected by the import module.

[0093] In an optional embodiment, referring to Figure 1 , checking the running result of the target batch processing job according to the at least one information through the checking module, including:

[0094] The checking module checks the file processing status corresponding to the target batch processing job based on the relevant information in the server executing the target batch processing job and the file information related to the target batch processing job.

[0095] In this implementation, the relevant information in the server that executes the target batch processing job refers to the job running information. The basic job information and job running step information of the target batch processing job can be first analyzed based on the job running information of the target batch processing job, and then the file processing status corresponding to the target batch processing job can be checked based on the basic job information, job running step information of the target batch processing job and the file information related to the target batch processing job.

[0096] Optionally, the checking module checks the file processing status corresponding to the target batch processing job based on the basic job information and job running step information of the target batch processing job output by the analysis module, as well as the file information related to the target batch processing job.

[0097] For example, the verification module checks whether the file is processed correctly based on the file offset information and upstream file information in the job configuration.

[0098] In an optional embodiment, referring to Figure 1 , checking the running result of the target batch processing job according to the at least one information through the checking module, including:

[0099] The file clearing and downloading status corresponding to the target batch processing job is checked through the checking module based on the job result data of the target batch processing job and the file information related to the target batch processing job.

[0100] Among them, downloading refers to writing the information in the database into a file, and clearing refers to deleting the corresponding information in the database.

[0101] For example, the verification module compares the database data information and file information before and after the target batch job is run to determine whether the corresponding files are correct and whether the corresponding data is cleared.

[0102] Optionally, before the target batch job runs, the database and NAS are accessed through an import tool to obtain database data information and file information before and after the target batch job runs. After the target batch job runs, it can be determined whether the corresponding files for downloading are correct and whether the corresponding data for clearing files is cleared.

[0103] In an optional embodiment, referring to Figure 1 , checking the running result of the target batch processing job according to the at least one information through the checking module, including:

[0104] The checking module checks the file transmission status corresponding to the target batch processing job based on the job result data of the target batch processing job and the file information related to the target batch processing job.

[0105] For example, the checking module checks whether the file transmission is correct according to the file transmission configuration information, the control file and the operation step return value.

[0106] In an optional embodiment, referring to Figure 1 , and also includes: checking the synchronization status of the replica corresponding to the target batch processing job through a checking module.

[0107] For example, the verification module checks whether the database operation is correct after the replica synchronization based on the upstream replica information and the database data information before the target batch job is run.

[0108] The above embodiments are merely exemplary descriptions of the functions of the analysis module and the verification module, and are not specific limitations on the analysis module and the verification module. In addition to the above embodiments, the analysis module and the verification module can also support other data analysis and verification of batch job operation results, which are not listed one by one in this embodiment.

[0109] Embodiment 4

[0110] Figure 3It is a structural diagram of a batch job verification device provided in Example 4 of the present invention, which can be applied to data collection, analysis and verification of batch job operation results. The device can be implemented in software and / or hardware and can generally be integrated in a computer device.

[0111] like Figure 3 As shown, the batch processing operation verification device specifically includes: an import module 310, an analysis module 320 and a verification module 330. Among them,

[0112] An import module 310, configured to collect at least one type of information related to the operation of a target batch job;

[0113] An analysis module 320, configured to perform data analysis on the operation status of the target batch processing job according to the at least one information;

[0114] The checking module 330 is used to check the running result of the target batch processing job according to the at least one information.

[0115] The technical solution provided by the embodiment of the present invention collects at least one kind of information related to the operation of the target batch processing job through an import module, performs data analysis on the operation status of the target batch processing job according to the at least one kind of information through an analysis module, and verifies the operation result of the target batch processing job according to the at least one kind of information through a verification module, thereby realizing the automation of batch processing job verification and improving verification efficiency.

[0116] Optionally, the import module 310 is specifically used to collect at least the scheduling information of the target batch processing job, the job result data of the target batch processing job, the file information related to the target batch processing job, and the related information in the server executing the target batch processing job.

[0117] Optionally, the analysis module 320 is specifically configured to analyze basic job information of the target batch processing job based on relevant information in a server that executes the target batch processing job.

[0118] Optionally, the analysis module 320 is specifically configured to analyze the job step running information of the target batch processing job based on the relevant information in the server executing the target batch processing job.

[0119] Optionally, the analysis module 320 is specifically configured to analyze a critical path of the target batch processing job based on the scheduling information of the target batch processing job; wherein the critical path affects the total duration of the target batch processing job execution sequence.

[0120] Optionally, the analysis module 320 is specifically configured to analyze the operation efficiency of the target batch processing job based on the scheduling information of the target batch processing job and the file information related to the target batch processing job.

[0121] Optionally, the analysis module 320 is specifically configured to analyze the processing status of the target batch processing job based on relevant information in the server that executes the target batch processing job.

[0122] Optionally, the analysis module 320 is specifically configured to analyze the task concurrency and load balancing conditions corresponding to the target batch processing job based on relevant information in the server executing the target batch processing job.

[0123] Optionally, the checking module 330 is specifically configured to check the file processing status corresponding to the target batch processing job based on the relevant information in the server executing the target batch processing job and the file information related to the target batch processing job.

[0124] Optionally, the verification module 330 is specifically used to verify the file clearing and file downloading status corresponding to the target batch processing job based on the job result data of the target batch processing job and the file information related to the target batch processing job.

[0125] Optionally, the checking module 330 is specifically configured to check the file transmission status corresponding to the target batch processing job based on the job result data of the target batch processing job and the file information related to the target batch processing job.

[0126] Optionally, the checking module 330 is further specifically configured to check the synchronization status of the replica corresponding to the target batch processing job.

[0127] The batch processing job verification device can execute the batch processing job verification method provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of executing the batch processing job verification method.

[0128] Since the batch job verification device introduced above is a device that can execute the batch job verification method in the embodiment of the present invention, based on the batch job verification method introduced in the embodiment of the present invention, the technical personnel in this field can understand the specific implementation method and various variations of the batch job verification device of this embodiment, so how the batch job verification device implements the batch job verification method in the embodiment of the present invention is not introduced in detail here. As long as the technical personnel in this field implement the device used by the batch job verification method in the embodiment of the present invention, it belongs to the scope of protection of this application.

[0129] Embodiment 5

[0130] Figure 4 A schematic diagram of the hardware structure of a computer device provided in Embodiment 5 of the present invention. Figure 4 A block diagram of an exemplary computer device 12 suitable for use in implementing embodiments of the present invention is shown. Figure 4 The computer device 12 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0131] like Figure 4 As shown, the computer device 12 is in the form of a general-purpose computing device. The components of the computer device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that connects various system components (including the system memory 28 and the processing unit 16).

[0132] Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor or a local bus using any of a variety of bus architectures. By way of example, these architectures include, but are not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MAC) bus, an Enhanced ISA bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnect (PCI) bus.

[0133] The computer device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the computer device 12, including volatile and non-volatile media, removable and non-removable media.

[0134] The system memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. The computer device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 34 may be used to read and write non-removable, non-volatile magnetic media ( Figure 4 not shown, usually called a "hard drive"). Although Figure 4 Not shown in the figure, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, a DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to the bus 18 via one or more data medium interfaces. The system memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to perform the functions of the various embodiments of the present invention.

[0135] A program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in system memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment. Program modules 42 generally perform the functions and / or methods of the embodiments described herein.

[0136] The computer device 12 may also communicate with one or more external devices 14 (e.g., keyboards, pointing devices, displays 24, etc.), one or more devices that enable a user to interact with the computer device 12, and / or any device that enables the computer device 12 to communicate with one or more other computing devices (e.g., network cards, modems, etc.). Such communication may be performed via an input / output (I / O) interface 22. Furthermore, the computer device 12 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 20. As shown, the network adapter 20 communicates with the other modules of the computer device 12 via the bus 18. It should be understood that although Figure 4 Not shown, other hardware and / or software modules may be used in conjunction with computer device 12, including but not limited to microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0137] The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, for example, implementing a batch processing job verification method provided by an embodiment of the present invention.

[0138] That is, when the processing unit executes the program, it realizes: collecting at least one information related to the operation of the target batch processing job through the import module; performing data analysis on the operation status of the target batch processing job according to the at least one information through the analysis module; and verifying the operation result of the target batch processing job according to the at least one information through the verification module.

[0139] Embodiment 6

[0140] Embodiment 6 of the present invention provides a computer-readable storage medium having a computer program stored thereon. When the program is executed by a processor, a batch processing job verification method as provided in all the embodiments of the present invention is implemented: that is, when the program is executed by the processor, at least one information related to the operation of the target batch processing job is collected through an import module; data analysis is performed on the operation status of the target batch processing job according to the at least one information through an analysis module; and the operation result of the target batch processing job is verified according to the at least one information through a verification module.

[0141] Any combination of one or more computer-readable media can be used. Computer-readable media can be computer-readable signal media or computer-readable storage media. Computer-readable storage media can be, for example, but not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or devices, or any combination of the above. More specific examples (non-exhaustive list) of computer-readable storage media include: electrical connections with one or more wires, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. In this document, computer-readable storage media can be any tangible medium containing or storing a program, which can be used by an instruction execution system, device or device or used in combination with it.

[0142] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, which carry computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0143] The program code embodied on the computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0144] Computer program code for performing the operation of the present invention can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​(such as Java, Smalltalk, C++), and also conventional procedural programming languages ​​(such as "C" language or similar programming languages). The program code can be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network (including a local area network LAN or a wide area network WAN), or, it can be connected to an external computer (for example, using an Internet service provider to connect through the Internet).

[0145] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A batch processing job verification method, characterized in that: include: Collecting at least one information related to the operation of the target batch processing job through the import module, including: collecting at least the scheduling information of the target batch processing job, the job result data of the target batch processing job, the file information related to the target batch processing job, and the related information in the server executing the target batch processing job through the import module; Performing data analysis on the operation status of the target batch processing job according to the at least one information by the analysis module, including: analyzing the basic job information of the target batch processing job based on the relevant information in the server executing the target batch processing job by the analysis module; The running result of the target batch processing job is checked according to the at least one information by a checking module.

2. The method according to claim 1, characterized in that Performing data analysis on the running status of the target batch processing job according to the at least one information through an analysis module includes: The analysis module analyzes the job step running information of the target batch processing job based on the relevant information in the server executing the target batch processing job.

3. The method according to claim 1, characterized in that Performing data analysis on the running status of the target batch processing job according to the at least one information through an analysis module includes: The analysis module analyzes a critical path of the target batch processing job based on the scheduling information of the target batch processing job; wherein the critical path affects the total duration of the target batch processing job execution sequence.

4. The method according to claim 1, characterized in that Performing data analysis on the running status of the target batch processing job according to the at least one information through an analysis module includes: The analysis module analyzes the operation efficiency of the target batch processing job based on the scheduling information of the target batch processing job and the file information related to the target batch processing job.

5. The method according to claim 1, characterized in that Performing data analysis on the running status of the target batch processing job according to the at least one information through an analysis module includes: The analysis module analyzes the processing status of the target batch processing job based on the relevant information in the server executing the target batch processing job.

6. The method according to claim 1, characterized in that Performing data analysis on the running status of the target batch processing job according to the at least one information through an analysis module includes: The analysis module analyzes the task concurrency and load balancing conditions corresponding to the target batch processing job based on the relevant information in the server executing the target batch processing job.

7. The method according to claim 1, characterized in that Checking the running result of the target batch processing job according to the at least one information by a checking module includes: The checking module checks the file processing status corresponding to the target batch processing job based on the relevant information in the server executing the target batch processing job and the file information related to the target batch processing job.

8. The method according to claim 1, characterized in that Checking the running result of the target batch processing job according to the at least one information by a checking module includes: The checking module checks the file clearing and downloading status corresponding to the target batch processing job based on the job result data of the target batch processing job and the file information related to the target batch processing job.

9. The method according to claim 1, characterized in that: Checking the running result of the target batch processing job according to the at least one information by a checking module includes: The checking module checks the file transmission status corresponding to the target batch processing job based on the job result data of the target batch processing job and the file information related to the target batch processing job.

10. The method according to claim 1, characterized in that Also includes: The checking module checks the synchronization status of the replica corresponding to the target batch processing job.

11. A batch processing job verification device, characterized in that: include: An import module is used to collect at least one kind of information related to the operation of the target batch processing job, specifically used to collect at least the scheduling information of the target batch processing job, the job result data of the target batch processing job, the file information related to the target batch processing job, and the related information in the server executing the target batch processing job; An analysis module, configured to perform data analysis on the operation status of the target batch processing job according to the at least one information, and specifically configured to analyze basic job information of the target batch processing job based on relevant information in a server executing the target batch processing job; A checking module is used to check the running result of the target batch processing job according to the at least one information.

12. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the method according to any one of claims 1 to 10 is implemented.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 10 is implemented.