Batch execution method, device, electronic device, medium and computer program product

Abstract

The present disclosure provides a batch execution method, device, electronic device, medium and computer program product based on a distributed architecture. The above method and device can be used in the field of distributed and big data technology. The batch execution method based on a distributed architecture includes: obtaining m batch files according to a business scenario, each of the batch files has a file attribute, wherein m is an integer greater than or equal to 1; setting trigger rules and verification rules for the m batch files; verifying the file attributes according to the verification rules; when the file attributes pass the verification, executing the m batch files according to the trigger rules; generating a batch link graph according to the trigger rules and the file attributes.

Description

Technical Field

[0001] The present disclosure relates to the field of distributed and big data technology, and more specifically, to a batch execution method, device, electronic device, computer-readable storage medium, and computer program product based on a distributed architecture. Background Art

[0002] In daily work, there are high-frequency batch scheduling scenarios, such as payment, reconciliation, inter-bank and other key transactions, which often involve complex processes of multiple applications, cross-host batches and cross-platform batches. Existing technologies cannot realize automatic on-demand scheduling of host and platform batches, and can only be operated manually, consuming a lot of manpower and material resources. Summary of the invention

[0003] In view of this, the present disclosure provides a batch execution method, device, electronic device, computer-readable storage medium and computer program product based on a distributed architecture that saves costs, has clear visual information and is efficient.

[0004] One aspect of the present disclosure provides a batch execution method based on a distributed architecture, including: acquiring m batch files according to a business scenario, each of the batch files having a file attribute, wherein m is an integer greater than or equal to 1; setting trigger rules and verification rules for the m batch files; verifying the file attributes according to the verification rules; when the file attributes pass the verification, executing the m batch files according to the trigger rules; and generating a batch link graph according to the trigger rules and the file attributes.

[0005] According to the batch execution method based on a distributed architecture of the embodiment of the present disclosure, the file attributes of the batch files are verified by setting verification rules, which lays an executable prerequisite for executing m batch files. When the verification fails, there is no need to trigger the execution of m batch files, which saves the process and further saves resources and costs. The execution status of the batch files can be clearly obtained through the batch link diagram, such as what the starting path is, what the receiving path is, how big the file size is, what the file type is, and when the file was generated. Therefore, it can be used as a reference for business personnel so that business personnel can know the execution status of batch files in real time. The present disclosure can realize cross-platform and cross-host batch automatic scheduling. Compared with the prior art, it can reduce manual execution, thereby improving the accuracy of execution, speeding up the time of batch execution, and improving work efficiency.

[0006] In some embodiments, the file attributes include at least one of file size, file type, and file generation time.

[0007] In some embodiments, the file attributes include file size, and verifying the file size according to the verification rule includes: setting a file size threshold; comparing the file size with the file size threshold; and when the file size meets the file size threshold, the file size passes the verification.

[0008] In some embodiments, when the file size does not meet the file size threshold, the batch file corresponding to the file size is split into n sub-batch files according to the file size threshold, so that the file size of each sub-batch file meets the file size threshold, where n is an integer greater than or equal to 2.

[0009] In some embodiments, the file attributes include a file type, and verifying the file type according to the verification rule includes: setting a file standard type; determining whether the file type is the file standard type; and when the file type is the file standard type, the file type passes the verification.

[0010] In some embodiments, the file attributes include a file generation time, and verifying the file generation time according to the verification rule includes: setting a generation time threshold; determining whether the file generation time meets the generation time threshold; and when the file generation time meets the generation time threshold, the file generation time passes the verification.

[0011] In some embodiments, the file attributes include the corresponding batch file including a formal file and a verification file, wherein the verification file records the information of the formal file; verifying the file attributes according to the verification rules includes: verifying whether the batch file includes the formal file and the verification file; and when the batch file includes the formal file and the verification file, the file attributes pass the verification.

[0012] In some embodiments, the trigger rule includes: the execution times of the m batch files; the starting path of each of the batch files; and the receiving path of each of the batch files.

[0013] In some embodiments, generating a batch link graph according to the trigger rules and the file attributes includes: generating nodes of the batch link graph according to the starting path and the receiving path; connecting the nodes corresponding to the starting path and the nodes corresponding to the receiving path of the same batch file to generate edges of the batch link graph.

[0014] In some embodiments, generating a batch link graph according to the trigger rule and the file attribute further includes: using the file attribute as an edge attribute of the batch link graph.

[0015] In some embodiments, the session includes a time period or a time point.

[0016] In some embodiments, the method further includes: generating an execution status of executing the m batch files; and visualizing the execution status.

[0017] In some embodiments, the method further comprises: generating a batch link graph according to the execution state, wherein the batch link graph has nodes and edges, and the execution state is an edge attribute of the edge.

[0018] Another aspect of the present disclosure provides a batch execution device based on a distributed architecture, including: an acquisition module, the acquisition module is used to execute acquisition of m batch files according to a business scenario, each of the batch files has a file attribute, wherein m is an integer greater than or equal to 1; a setting module, the setting module is used to set trigger rules and verification rules for the m batch files; a verification module, the verification module is used to verify the file attributes according to the verification rules; an execution module, the execution module is used to execute the m batch files according to the trigger rules when the file attributes pass the verification; and a generation module, the generation module is used to generate a batch link graph according to the trigger rules and the file attributes.

[0019] Another aspect of the present disclosure provides an electronic device, comprising one or more processors and one or more memories, wherein the memories are used to store executable instructions, and when the executable instructions are executed by the processors, the above-mentioned method is implemented.

[0020] Another aspect of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, which are used to implement the above method when executed.

[0021] Another aspect of the present disclosure provides a computer program product, comprising a computer program, wherein the computer program comprises computer executable instructions, and the instructions are used to implement the method as described above when executed. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The above and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:

[0023] Figure 1 An exemplary system architecture to which the method and apparatus according to an embodiment of the present disclosure can be applied is schematically shown;

[0024] Figure 2 A flowchart of a batch execution method based on a distributed architecture according to an embodiment of the present disclosure is schematically shown;

[0025] Figure 3 Schematically shows a flow chart of checking the file size according to the checking rule according to an embodiment of the present disclosure;

[0026] Figure 4 A flowchart of checking a file type according to a checking rule according to an embodiment of the present disclosure is schematically shown;

[0027] Figure 5 A flowchart of verifying the file generation time according to the verification rules according to an embodiment of the present disclosure is schematically shown;

[0028] Figure 6 A flowchart of verifying file attributes according to verification rules according to an embodiment of the present disclosure is schematically shown;

[0029] Figure 7 A flowchart of generating a batch link graph according to trigger rules and file attributes according to an embodiment of the present disclosure is schematically shown;

[0030] Figure 8 A schematic diagram of a batch link graph according to an embodiment of the present disclosure is schematically shown by taking a cross-application batch as an example;

[0031] Fig. 9 A flowchart of a batch execution method based on a distributed architecture according to an embodiment of the present disclosure is schematically shown;

[0032] Fig.10 A flowchart of a batch execution method based on a distributed architecture according to an embodiment of the present disclosure is schematically shown;

[0033] Fig.11 A flowchart of a batch execution method based on a distributed architecture according to an embodiment of the present disclosure is schematically shown;

[0034] Fig.12 A flowchart of a batch execution method based on a distributed architecture according to an embodiment of the present disclosure is schematically shown;

[0035] Fig.13 A block diagram of a batch execution device based on a distributed architecture according to an embodiment of the present disclosure is schematically shown;

[0036] Fig.14 A block diagram of an electronic device according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0037] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0038] In the technical solution of this disclosure, the acquisition, storage and application of user personal information involved are in compliance with the provisions of relevant laws and regulations, necessary confidentiality measures are taken, and they do not violate public order and good morals. In the technical solution of this disclosure, the acquisition, collection, storage, use, processing, transmission, provision, disclosure and application of data are in compliance with the provisions of relevant laws and regulations, necessary confidentiality measures are taken, and they do not violate public order and good morals.

[0039] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0040] When using expressions such as "at least one of A, B or C, etc.", it should generally be interpreted in accordance with the meaning of the expression generally understood by those skilled in the art (for example, "a system having at least one of A, B or C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.). The terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, features defined as "first" and "second" may explicitly or implicitly include one or more of the said features.

[0041] In daily work, there are high-frequency batch scheduling scenarios, such as payment, reconciliation, inter-bank and other key transactions, which often involve complex processes of multiple applications, cross-host batches and cross-platform batches. Existing technologies cannot realize automatic on-demand scheduling of host and platform batches, and can only be operated manually, consuming a lot of manpower and material resources.

[0042] The embodiments of the present disclosure provide a batch execution method, device, electronic device, computer-readable storage medium and computer program product based on a distributed architecture. The batch execution method based on a distributed architecture includes: obtaining m batch files according to a business scenario, each batch file has a file attribute, where m is an integer greater than or equal to 1; setting trigger rules and verification rules for the m batch files; verifying the file attributes according to the verification rules; when the file attributes pass the verification, executing the m batch files according to the trigger rules; and generating a batch link diagram according to the trigger rules and the file attributes.

[0043] It should be noted that the batch execution method, device, electronic device, computer-readable storage medium and computer program product based on a distributed architecture disclosed in the present invention can be used in the fields of distributed and big data technology, and can also be used in any field other than the fields of distributed and big data technology, such as the financial field. The field of the present invention is not limited here.

[0044] Figure 1 The exemplary system architecture 100 to which the batch execution method, apparatus, electronic device, computer-readable storage medium and computer program product based on the distributed architecture according to the embodiment of the present disclosure can be applied is schematically shown. It should be noted that: Figure 1 What is shown is merely an example of a system architecture to which the embodiments of the present disclosure can be applied, in order to help those skilled in the art understand the technical content of the present disclosure, but it does not mean that the embodiments of the present disclosure cannot be used in other devices, systems, environments or scenarios.

[0045] like Figure 1 As shown, the system architecture 100 according to this embodiment may include terminal devices 101, 102, 103, a network 104 and a server 105. The network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0046] Users can use terminal devices 101, 102, 103 to interact with server 105 through network 104 to receive or send messages, etc. Various communication client applications can be installed on terminal devices 101, 102, 103, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only examples).

[0047] The terminal devices 101 , 102 , and 103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, and desktop computers.

[0048] The server 105 may be a server that provides various services, such as a background management server (only an example) that provides support for websites browsed by users using the terminal devices 101, 102, and 103. The background management server may analyze and process the received data such as user requests, and feed back the processing results (such as web pages, information, or data obtained or generated according to user requests) to the terminal device.

[0049] It should be noted that the batch execution method based on the distributed architecture provided in the embodiment of the present disclosure can generally be executed by the server 105. Accordingly, the batch execution device based on the distributed architecture provided in the embodiment of the present disclosure can generally be set in the server 105. The batch execution method based on the distributed architecture provided in the embodiment of the present disclosure can also be executed by a server or server cluster that is different from the server 105 and can communicate with the terminal devices 101, 102, 103 and / or the server 105. Accordingly, the batch execution device based on the distributed architecture provided in the embodiment of the present disclosure can also be set in a server or server cluster that is different from the server 105 and can communicate with the terminal devices 101, 102, 103 and / or the server 105.

[0050] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0051] The following will be based on Figure 1 The scene described by Figure 2 to Figure 12 The batch execution method based on the distributed architecture of the embodiment of the present disclosure is described in detail.

[0052] Figure 2 The flowchart of the batch execution method based on the distributed architecture according to the embodiment of the present disclosure is schematically shown.

[0053] like Figure 2 As shown, the batch execution method based on the distributed architecture of this embodiment includes operations S210 to S250.

[0054] In operation S210, m batch files are obtained according to the business scenario, each batch file has a file attribute, wherein m is an integer greater than or equal to 1. It is understandable that the business scenario may be, for example, a key transaction scenario such as payment, reconciliation, and inter-bank, and in the above scenario, it may involve the need to batch execute m batch files between multiple applications, the need to batch execute m batch files between multiple hosts, and / or the need to batch execute m batch files between multiple platforms.

[0055] As a possible implementation method, the file attribute may include at least one of the file size, the file type, and the file generation time. Among them, the file attribute may include only the file size, the file attribute may include only the file type, the file attribute may include only the file generation time; the file attribute may also include the file size and the file type, the file attribute may also include the file size and the file generation time, the file attribute may also include the file type and the file generation time; the file attribute may also include the file size, the file type, and the file generation time. Therefore, the file attribute may include at least one of the file size, the file type, and the file generation time, which can enrich the types of file attributes, lay a data foundation for verifying the file attributes according to the verification rules below, and make the verification results more comprehensive and accurate.

[0056] In operation S220, trigger rules and verification rules are set for the m batch files, wherein the trigger rule can be understood as a trigger condition for starting to execute the m batch files; and the verification rule can be understood as a rule for verifying file attributes.

[0057] In operation S230, the file attributes are verified according to the verification rules. For example, the file size is verified to see if it meets the rules; the file type is verified to see if it meets the type of files to be executed in batches; the file generation time is verified to see if it meets the generation time of files to be executed in batches, but it is not limited to this. Verifying the file attributes according to the verification rules is based on the specific content of the file attributes, which is not specifically limited here.

[0058] In operation S240, when the file attributes pass the verification, the m batch files are executed according to the triggering rule.

[0059] In operation S250, a batch link graph is generated according to the trigger rules and the file attributes. It should be noted that the batch link graph can be understood as a knowledge graph, which includes nodes, edges, and edge attributes, wherein nodes and edges can be constructed according to the trigger rules, and edge attributes can be generated according to the file attributes. However, the understanding of the batch link graph is not limited to this, and the batch link graph can also be a display graph in other forms, which is not too restrictive here.

[0060] According to the batch execution method based on a distributed architecture of the embodiment of the present disclosure, the file attributes of the batch files are verified by setting verification rules, which lays an executable prerequisite for executing m batch files. When the verification fails, there is no need to trigger the execution of m batch files, which saves the process and further saves resources and costs. The execution status of the batch files can be clearly obtained through the batch link diagram, such as what the starting path is, what the receiving path is, how big the file size is, what the file type is, and what the file generation time is. Therefore, it can be used as a reference for business personnel so that business personnel can know the execution status of the batch files in real time. The present disclosure can realize cross-platform and cross-host batch automatic scheduling through operations S210 to S250. Compared with the prior art, it can reduce manual execution, thereby improving the accuracy of execution, speeding up the time of batch execution, and improving work efficiency.

[0061] In some embodiments of the present disclosure, file attributes may include file size, such as Figure 3 As shown, operation S230 of verifying the file size according to the verification rule may include operations S310 to S330.

[0062] In operation S310, a file size threshold is set. Here, the file size threshold may be a numerical value or a numerical range.

[0063] In operation S320, the file size is compared with a file size threshold.

[0064] In operation S330, when the file size meets the file size threshold, the file size passes verification. For example, when the file size threshold is a numerical value, if the file size is less than the threshold, the file size passes verification; for another example, when the file size threshold is a numerical value, if the file size is greater than the threshold, the file size passes verification; for another example, when the file size threshold is a numerical value interval, if the file size is within the file size threshold, the file size passes verification. Thus, through operations S310 to S330, it is easy to implement file size verification according to verification rules.

[0065] As some specific examples, when the file size does not meet the file size threshold, the batch file corresponding to the file size can be split into n sub-batch files according to the file size threshold, so that the file size of each sub-batch file meets the file size threshold, where n is an integer greater than or equal to 2. Therefore, when the batch file cannot be executed due to the large file size, the batch file can be split to meet the execution condition, thereby improving the success rate and efficiency of executing the batch file.

[0066] In some embodiments of the present disclosure, file attributes may include file types, such as Figure 4As shown, operation S230 of verifying the file type according to the verification rule includes operations S410 to S430.

[0067] In operation S410, the standard file type is set. Here, the standard file type can be a .chk file, a .bin file, or other types of files. The standard file type can be set according to actual business scenarios and needs, and is not limited here.

[0068] In operation S420, it is determined whether the file type is a standard file type.

[0069] In operation S430, when the file type is a standard file type, the file type passes the verification. Thus, through operations S410 to S430, it is convenient to verify the file type according to the verification rule.

[0070] In some specific examples, when the file type does not conform to the file standard type, the file type fails to pass the verification.

[0071] In some embodiments of the present disclosure, the file attributes may include the file generation time, such as Figure 5 As shown, operation S230 of verifying the file generation time according to the verification rule includes operations S510 to S530.

[0072] In operation S510, a generation time threshold is set. Here, the generation time threshold may be a numerical value or a numerical range.

[0073] In operation S520 , it is determined whether the file generation time satisfies a generation time threshold.

[0074] In operation S530, when the file generation time meets the generation time threshold, the file generation time passes verification. For example, when the generation time threshold is a numerical value, if the file generation time is less than the threshold, the file generation time passes verification; for another example, when the generation time threshold is a numerical value, if the file generation time is greater than the threshold, the file generation time passes verification; for another example, when the generation time threshold is a numerical value interval, if the file generation time is within the generation time threshold, the file generation time passes verification. Thus, through operations S510 to S530, it is easy to implement the verification of the file generation time according to the verification rule.

[0075] In some specific examples, when the file generation time does not meet the generation time threshold, the file generation time cannot pass the verification.

[0076] In some embodiments of the present disclosure, the file attributes may include a corresponding batch file including a formal file and a verification file, wherein the verification file records the information of the formal file. It should be noted that each batch file may include two file types, for example, one is a .chk file, which is the formal file of the batch file, that is, the business data file; the other is a .bin file, which is a verification file, and the verification file may record the information of the formal file.

[0077] like Figure 6 As shown, operation S230 of verifying the file attribute according to the verification rule includes operations S610 to S620.

[0078] In operation S610, it is verified whether the batch file includes the formal file and the verification file.

[0079] In operation S620, when the batch file includes the formal file and the verification file, the file attribute passes the verification. It can be understood that if the batch file does not include any one of the formal file and the verification file, the file attribute cannot pass the verification; if the batch file does not include the formal file or the verification file, the file attribute cannot pass the verification. Therefore, through operations S610 to S620, it is easy to implement the verification of file attributes according to the verification rules.

[0080] According to some embodiments of the present disclosure, the triggering rules may include: the number of times m batch files are executed; the starting path of each batch file; and the receiving path of each batch file. In batch operations across applications, the starting path can be understood as the application address of the outgoing data, and the receiving path can be understood as the application address of the received data; in batch operations across platforms, the starting path can be understood as the platform address of the outgoing data, and the receiving path can be understood as the platform address of the received data; in batch operations across hosts, the starting path can be understood as the host address of the outgoing data, and the receiving path can be understood as the host address of the received data.

[0081] Therefore, the m batch files can be executed according to the execution times of the m batch files, the starting path of each batch file and the receiving path of each batch file, so as to facilitate the execution of the m batch files according to the triggering rules.

[0082] As a possible implementation method, the session may include a time period or a time point. Thus, the sessions for executing m batch files are enriched, the diversity of session requirements can be met, and at the same time, it is easy to execute m batch files according to the sessions for executing m batch files.

[0083] Figure 7 A flowchart of generating a batch link graph according to trigger rules and file attributes according to an embodiment of the present disclosure is schematically shown.

[0084] Figure 8 A schematic diagram of a batch link graph according to an embodiment of the present disclosure is schematically shown by taking cross-application batch as an example.

[0085] like Figure 7 As shown, operation S250 of generating a batch link graph according to the trigger rule and the file attribute includes operation S251 and operation S252.

[0086] In operation S251 , nodes of a batch link graph are generated according to the start path and the reception path.

[0087] In operation S252, the nodes corresponding to the starting path and the nodes corresponding to the receiving path of the same batch file are connected to generate the edges of the batch link graph. Thus, according to operations S251 and S252, it is convenient to realize the generation of the batch link graph according to the trigger rules and file attributes.

[0088] As a possible implementation method, Figure 7 As shown, operation S250 generates a batch link graph according to the trigger rule and the file attribute and further includes operation S253: using the file attribute as the edge attribute of the batch link graph. Thus, the batch link graph can clearly display the execution status of the batch files, such as what the starting path is, what the receiving path is, how big the file size is, what the file type is, and when the file was generated. Thus, it can be used as a reference for business personnel, so that the business personnel can know the execution status of the batch files in real time.

[0089] Fig. 9 The flowchart of the batch execution method based on the distributed architecture according to the embodiment of the present disclosure is schematically shown.

[0090] like Fig. 9 As shown, the batch execution method based on the distributed architecture also includes operation S001 and operation S002.

[0091] In operation S001, the execution status of executing m batch files is generated. As a possible implementation method, the execution status may include at least one of the execution process, the completion status and the execution time. The execution process may be understood as the number of executed, the number of being executed and the number of unexecuted files in the m batch files; the completion status may be understood as the status of executing the m batch files, for example, the completion status may include the unstarted state, the executing state and the completed state; the execution time may be understood as the time when each batch file is executed.

[0092] In operation S002, the execution status is visualized. Thus, the business personnel can clearly understand the execution progress, completion status and execution time of the m batch files through the visualization of the execution status, so as to facilitate the smooth progress of the work of the business personnel.

[0093] Fig.10 The flowchart of the batch execution method based on the distributed architecture according to the embodiment of the present disclosure is schematically shown.

[0094] like Fig.10 As shown, the batch execution method based on the distributed architecture also includes operation S003.

[0095] In operation S003, a batch link graph is generated according to the execution status, wherein the batch link graph has nodes and edges, and the execution status is the edge attribute of the edge. Thus, the execution status can be reflected on the batch link graph, so that business personnel can monitor the execution of m batch files in real time through the batch link graph. This enables one-click execution and full-link tracking of the full batch process between multiple applications, multiple platforms, and multiple hosts, and real-time viewing of batch progress.

[0096] Fig.11 The flowchart of the batch execution method based on the distributed architecture according to the embodiment of the present disclosure is schematically shown.

[0097] like Fig.11 As shown, the batch execution method based on the distributed architecture also includes operation S004.

[0098] In operation S004, log information when executing m batch files is generated according to the trigger rule, file attributes and execution status. It can be understood that the log information can realize status monitoring when executing m batch files.

[0099] Fig.12 The flowchart of the batch execution method based on the distributed architecture according to the embodiment of the present disclosure is schematically shown.

[0100] like Fig.12 As shown, the batch execution method based on the distributed architecture also includes operation S005.

[0101] In operation S005, a batch link diagram is generated according to the log information. Thus, the log information can be displayed in real time in the batch link diagram. As a possible implementation method, the log information can be retrieved by date, so that the log information can be viewed and retrieved according to the needs to understand the execution status of the batch files that you want to know. In addition, generating a batch link diagram according to the log information makes the content of the batch link diagram richer, which can provide business personnel with richer knowledge references, thereby improving the business personnel's user experience.

[0102] Based on the above-mentioned batch execution method based on distributed architecture, the present disclosure also provides a batch execution device 10 based on distributed architecture. Fig.13 The batch execution device 10 based on the distributed architecture is described in detail.

[0103] Fig.13 The structural block diagram of a batch execution device 10 based on a distributed architecture according to an embodiment of the present disclosure is schematically shown.

[0104] The batch execution device 10 based on the distributed architecture includes an acquisition module 1 , a setting module 2 , a verification module 3 , an execution module 4 and a generation module 5 .

[0105] The acquisition module 1 is used to perform operation S210: acquiring m batch files according to a business scenario, each batch file having a file attribute, wherein m is an integer greater than or equal to 1.

[0106] Setting module 2, setting module 2 is used to perform operation S220: setting trigger rules and verification rules for m batch files.

[0107] Verification module 3, verification module 3 is used to perform operation S230: verify the file attribute according to the verification rule.

[0108] The execution module 4 is used to execute operation S240: when the file attribute passes the verification, m batch files are executed according to the triggering rule.

[0109] The generating module 5 is used to perform operation S250: generating a batch link graph according to the triggering rule and the file attribute.

[0110] Since the above-mentioned batch execution device 10 based on distributed architecture is set based on the batch execution method of distributed architecture, the beneficial effects of the above-mentioned batch execution device 10 based on distributed architecture are the same as those of the batch execution method based on distributed architecture, which will not be repeated here.

[0111] In addition, according to an embodiment of the present disclosure, any multiple modules among the acquisition module 1, the setting module 2, the verification module 3, the execution module 4 and the generation module 5 can be combined into one module for implementation, or any one of the modules can be split into multiple modules. Alternatively, at least part of the functions of one or more of these modules can be combined with at least part of the functions of other modules and implemented in one module.

[0112] According to an embodiment of the present disclosure, at least one of the acquisition module 1, the setting module 2, the verification module 3, the execution module 4 and the generation module 5 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application-specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or can be implemented in any one of the three implementation methods of software, hardware and firmware, or in an appropriate combination of any of them.

[0113] Alternatively, at least one of the acquisition module 1, the setting module 2, the verification module 3, the execution module 4 and the generation module 5 may be at least partially implemented as a computer program module, and when the computer program module is executed, the corresponding function may be executed.

[0114] The following describes in detail a batch execution device based on a distributed architecture according to an embodiment of the present disclosure. It is worth noting that the following description is only an exemplary description and is not a specific limitation of the present disclosure.

[0115] The present disclosure implements a device for customizing and executing batch process rules. When the business personnel determine the applications and corresponding batches involved in the batch scenarios to be verified. A batch rule customization module is required, using rule templates, selecting batch rules in sequence according to the classification principles of host batches and platform batches, and entering detailed information. This information will be transmitted to the batch automatic scheduling module after the rule customization is completed. The system will automatically generate a visual link diagram according to the customized rules, and automatically detect whether it can be run. Finally, one-click batch call-up and full-link progress tracking are realized. And the detailed batch scheduling log is fed back to the log refresh module to realize batch monitoring.

[0116] A batch execution device based on a distributed architecture includes a rule customization module, a batch automatic scheduling module, a log refresh module and a link visualization module.

[0117] Rule customization module: used for businesses to customize batch trigger rules, file verification rules, database retrieval rules, etc. according to test scenarios, and send them to the batch automatic scheduling module and link visualization module.

[0118] Batch automatic scheduling module: used to receive data transmitted from the rule customization module, analyze and detect feasibility, and automatically compile problem-free rules into batch links for transmission to the link visualization module.

[0119] Log refresh module: receives batch progress information and various monitoring information transmitted by the batch automatic scheduling module, refreshes the corresponding logs in real time and sends them to the link visualization module.

[0120] Link visualization module: stores batch details from the rule customization module, matches the feasible batch links sent by the batch automatic scheduling module one by one, and generates a batch link diagram for the corresponding business scenario. When executing batch scheduling, it feeds back information to the batch automatic scheduling module in real time. Receives and displays log data from the log refresh module.

[0121] The batch execution device based on the distributed architecture can perform the following steps:

[0122] Step 201: The business customizes batch trigger rules, file verification rules, database search rules and other information according to the test scenario and sends them to the batch automatic scheduling module.

[0123] Step 202: The business customizes batch trigger rules, file verification rules, database search rules and other information according to the test scenario and sends them to the link visualization module.

[0124] Step 203: Rules without problems are automatically compiled into batch links. When they are called up, they are triggered in a distributed manner according to the respective triggering logic of the host batch and the platform batch. Multiple batches are called up in parallel and file verification is performed before and after the calling up. The files are transmitted to the link visualization module in real-time communication.

[0125] Step 204: When batch triggering, real-time data is sent to the log refresh module to implement log information monitoring.

[0126] Step 205: The link visualization module receives the batch information in real time and transmits it back to the batch automatic scheduling module according to the behavior of the front-end user.

[0127] Step 206: The log refresh module sends the log information to the link visualization module in real time to display the batch progress log and file and database verification details.

[0128] Fig.14 A block diagram of an electronic device suitable for implementing a batch execution method based on a distributed architecture according to an embodiment of the present disclosure is schematically shown.

[0129] like Fig.14 As shown, the electronic device 900 according to an embodiment of the present disclosure includes a processor 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage part 908 into a random access memory (RAM) 903. The processor 901 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or a related chipset and / or a special-purpose microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 901 may also include an onboard memory for caching purposes. The processor 901 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0130] In RAM 903, various programs and data required for the operation of electronic device 900 are stored. Processor 901, ROM 902 and RAM 903 are connected to each other via bus 904. Processor 901 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 902 and / or RAM 903. It should be noted that the program can also be stored in one or more memories other than ROM 902 and RAM 903. Processor 901 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in the one or more memories.

[0131] According to an embodiment of the present disclosure, the electronic device 900 may further include an input / output (I / O) interface 905, which is also connected to the bus 904. The electronic device 900 may further include one or more of the following components connected to the I / O interface 905: an input portion 906 including a keyboard, a mouse, etc.; an output portion 907 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 908 including a hard disk, etc.; and a communication portion 909 including a network interface card such as a LAN card, a modem, etc. The communication portion 909 performs communication processing via a network such as the Internet. A drive 910 is also connected to the input / output (I / O) interface 905 as needed. A removable medium 911, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 910 as needed, so that a computer program read therefrom is installed into the storage portion 908 as needed.

[0132] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.

[0133] According to an embodiment of the present disclosure, a computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, an apparatus, or a device. For example, according to an embodiment of the present disclosure, a computer-readable storage medium may include the ROM 902 and / or RAM 903 described above and / or one or more memories other than ROM 902 and RAM 903.

[0134] The embodiment of the present disclosure also includes a computer program product, which includes a computer program, and the computer program contains program code for executing the method shown in the flowchart. When the computer program product is run in a computer system, the program code is used to enable the computer system to implement the method of the embodiment of the present disclosure.

[0135] The above functions defined in the system / device of the embodiment of the present disclosure are performed when the computer program is executed by the processor 901. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0136] In one embodiment, the computer program may be based on a tangible storage medium such as an optical storage device, a magnetic storage device, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of a signal on a network medium, and downloaded and installed through the communication part 909, and / or installed from a removable medium 911. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0137] In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 909, and / or installed from the removable medium 911. When the computer program is executed by the processor 901, the above functions defined in the system of the embodiment of the present disclosure are performed. According to the embodiment of the present disclosure, the system, device, means, module, unit, etc. described above can be implemented by a computer program module.

[0138] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect through the Internet).

[0139] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0140] It will be appreciated by those skilled in the art that the features described in the various embodiments and / or claims of the present disclosure may be combined and / or combined in a variety of ways, even if such combinations and / or combinations are not explicitly described in the present disclosure. In particular, the features described in the various embodiments and / or claims of the present disclosure may be combined and / or combined in a variety of ways without departing from the spirit and teachings of the present disclosure. All of these combinations and / or combinations fall within the scope of the present disclosure.

[0141] The embodiments of the present disclosure are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present disclosure. Although the embodiments are described above separately, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. The scope of the present disclosure is defined by the attached claims and their equivalents. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A batch execution method based on a distributed architecture, characterized in that: include: Obtain m batch files according to the business scenario, each of the batch files having a file attribute, wherein m is an integer greater than or equal to 1; Setting trigger rules and verification rules for the m batch files; Verify the file attributes according to the verification rule; When the file attributes pass the verification, executing the m batch files according to the trigger rule; and Generate a batch link graph according to the trigger rule and the file attribute; The triggering rules include: the number of times the m batch files are executed; the starting path of each batch file; and the receiving path of each batch file; Wherein, generating a batch link graph according to the trigger rule and the file attribute includes: Generate nodes of the batch link graph according to the starting path and the receiving path; The nodes corresponding to the starting path and the nodes corresponding to the receiving path of the same batch file are connected to generate the edges of the batch link graph.

2. The method according to claim 1, characterized in that The file attribute includes at least one of a file size, a file type, and a file generation time.

3. The method according to claim 2, characterized in that The file attribute includes a file size, and verifying the file size according to the verification rule includes: Set file size threshold; comparing the file size to the file size threshold; and When the file size meets the file size threshold, the file size passes the verification.

4. The method according to claim 3, characterized in that When the file size does not meet the file size threshold, the batch file corresponding to the file size is split into n sub-batch files according to the file size threshold, so that the file size of each sub-batch file meets the file size threshold, where n is an integer greater than or equal to 2.

5. The method according to claim 2, characterized in that: The file attribute includes a file type, and verifying the file type according to the verification rule includes: Set the file standard type; Determining whether the file type is the standard file type; and When the file type is the standard file type, the file type passes the verification.

6. The method according to claim 2, characterized in that The file attribute includes a file generation time, and verifying the file generation time according to the verification rule includes: Set the generation time threshold; Determining whether the file generation time meets the generation time threshold; and When the file generation time meets the generation time threshold, the file generation time passes the verification.

7. The method according to claim 1, characterized in that The file attributes include that the corresponding batch files include a formal file and a verification file, wherein the verification file records the information of the formal file; Verifying the file attribute according to the verification rule includes: Verifying whether the batch file includes the formal file and the verification file; and When the batch file includes the formal file and the verification file, the file attribute passes the verification.

8. The method according to claim 1, characterized in that The generating a batch link graph according to the trigger rule and the file attribute further includes: using the file attribute as an edge attribute of the batch link graph.

9. The method according to claim 1, characterized in that: The session includes a time period or a time point.

10. The method according to any one of claims 1 to 9, characterized in that Also includes: Generate an execution status of executing the m batch files; as well as Visualize the execution status.

11. The method according to claim 10, characterized in that Also includes: A batch link graph is generated according to the execution state, wherein the batch link graph has nodes and edges, and the execution state is an edge attribute of the edge.

12. A batch execution device based on a distributed architecture, characterized in that: include: An acquisition module, the acquisition module is used to acquire m batch files according to a business scenario, each of the batch files having a file attribute, wherein m is an integer greater than or equal to 1; A setting module, the setting module is used to execute trigger rules and verification rules for the m batch files; A verification module, the verification module is used to verify the file attribute according to the verification rule; an execution module, the execution module being configured to execute the m batch files according to the trigger rule when the file attribute passes the verification; and A generation module, the generation module is used to generate a batch link graph according to the trigger rule and the file attribute; The triggering rules include: the times of executing the m batch files; the starting path of each batch file; and the receiving path of each batch file; Wherein, generating a batch link graph according to the trigger rule and the file attribute includes: Generate nodes of the batch link graph according to the starting path and the receiving path; The nodes corresponding to the starting path and the nodes corresponding to the receiving path of the same batch file are connected to generate the edges of the batch link graph.

13. An electronic device, characterized in that: include: one or more processors; One or more memories, used to store executable instructions, which, when executed by the processor, implement the method according to any one of claims 1 to 11.

14. A computer-readable storage medium, characterized in that: The storage medium stores executable instructions, which, when executed by a processor, implement the method according to any one of claims 1 to 11.

15. A computer program product, characterized in that The method comprises a computer program, wherein the computer program comprises one or more executable instructions, and when the executable instructions are executed by a processor, the method according to any one of claims 1 to 11 is implemented.

Images