A method and device for processing batch-to-online files

Abstract

The present application provides a method and device for processing batch-to-online files, relating to the field of data analysis technology. The batch-to-online file processing method can obtain a target file identifier based on a target business identifier and preset transaction file configuration information; obtain executable data corresponding to the target business identifier based on the target file identifier and file index information of a distributed system; read the data of the target batch-to-online file based on the executable data; perform splicing processing on the read data to obtain target splicing information; obtain parsed data based on the target splicing information and preset business rules, and assemble the parsed data into summary information. This method implements efficient summary processing of batch-to-online files, provides convenience for checking batch-to-online files, and can improve the efficiency of summary processing of batch-to-online files.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of data analysis technology, and in particular to a method and device for batch-to-online file processing. Background Art

[0002] Currently, in the operation of financial business systems, batch transfer to online business is inevitable, that is, batch initiation of requests to call online transaction operations.

[0003] Batch transfers generate multi-partitioned files. These files are divided into multiple partitions, and each partition file is further divided into multiple pieces, multiplying the data. The large number of files and the large amount of data in batch transfers create significant challenges for verification. Currently, batch transfers rely primarily on manual file identification, resulting in low processing efficiency. Summary of the Invention

[0004] In order to solve the existing technical problems, the embodiments of the present application provide a method and device for processing batch-to-online files, which can realize efficient aggregation processing of batch-to-online files and improve the efficiency of batch-to-online file processing.

[0005] To achieve the above objectives, the technical solution of the embodiment of the present application is implemented as follows:

[0006] In a first aspect, an embodiment of the present application provides a method for processing batch-to-online files, the method comprising:

[0007] Obtaining a target file identifier based on a target service identifier and preset transaction file configuration information; the target service identifier represents a range of services to be processed when processing batch files for online conversion; the transaction file configuration information includes a correspondence between the service identifier and the file identifier of the batch files for online conversion;

[0008] Obtaining executable data corresponding to the target service identifier based on the target file identifier and file index information of the distributed system; the file index information includes the file identifier of the batch-to-online file and corresponding path information of the batch-to-online file; the executable data is path information of the target batch-to-online file in the distributed system that needs to be processed when processing the batch-to-online file;

[0009] Reading data of the target batch-to-online file based on the executable data;

[0010] Splicing the read data to obtain target splicing information; the target splicing information includes the data of the target batch-converted online file;

[0011] According to the target splicing information and preset business rules, parsed data is obtained, and the parsed data is assembled into summary information.

[0012] The batch-to-online file processing method provided in the embodiment of the present application automatically retrieves the batch-to-online files that need to be analyzed, reads the content of each batch-to-online file and splices them to obtain splicing information, and parses and assembles the splicing information according to preset business rules, thereby achieving efficient summary processing of the batch-to-online files and improving the efficiency of batch-to-online file processing.

[0013] In an optional embodiment, obtaining the target file identifier according to the target service identifier and preset transaction file configuration information includes:

[0014] If the monitoring reaches the next start time corresponding to the batch-to-online file processing task, the target file identifier is obtained according to the target business identifier and preset transaction file configuration information included in the parameter information of the batch-to-online file processing task.

[0015] The method of the above embodiment automatically implements efficient summary processing of batch-to-online files according to the next startup time corresponding to the batch-to-online file processing task, further provides convenience for the verification of batch-to-online files and improves the efficiency of batch-to-online file processing.

[0016] In an optional embodiment, before the monitoring reaches the next start time corresponding to the batch-to-online file processing task, the method further includes:

[0017] Obtain the batch-to-online file processing task set by the user; the parameter information of the batch-to-online file processing task includes the approved running time information and the target business identifier; the approved running time information is used to determine the next startup time for the batch-to-online file processing corresponding to the target business identifier.

[0018] The method of the above embodiment reduces human intervention and improves the flexibility of batch-to-online file processing by setting batch-to-online file processing tasks, further provides convenience for batch-to-online file verification, and improves the efficiency of batch-to-online file processing.

[0019] In an optional embodiment, the parameter information further includes batch rules; the file index information further includes batch information corresponding to the batch-to-online files; and obtaining executable data corresponding to the target service identifier based on the target file identifier and the file index information of the distributed system includes:

[0020] Obtaining the target query batch according to the batch rule and the next start time;

[0021] Retrieving the file index information of the distributed system based on the target file identifier and the target query batch to obtain target file index information;

[0022] According to the path information of the batch-to-online files contained in the target file index information, executable data corresponding to the target query batch and the target business identifier is generated.

[0023] The method of the above embodiment determines the target file index information based on the target file identifier and batch information, obtains executable data corresponding to the target query batch and the target business identifier, improves the precision of batch-to-online file processing, improves the accuracy of batch-to-online file processing, further provides convenience for the verification of batch-to-online files, and improves the efficiency of batch-to-online file processing.

[0024] In an optional embodiment, the method further includes:

[0025] In response to a report generation instruction input by a user, obtaining statistical information corresponding to the target business identifier based on the summary information;

[0026] Based on the statistical information, a multidimensional report is generated; the multidimensional report includes part or all of the following items: the business success rate corresponding to a single target business identifier, the business success rate corresponding to multiple target business identifiers, a business success rate trend chart corresponding to a single target business identifier in a target time period, and a data details table corresponding to multiple target business identifiers; the data details table includes the statistical data.

[0027] The method of the above embodiment can generate multi-dimensional reports according to user needs, further facilitate the verification of batch-to-online files, and improve the efficiency of batch-to-online file processing.

[0028] In an optional embodiment, the transaction file configuration information is set by the user through an application layer interface.

[0029] In the method of the above embodiment, the user sets the transaction file configuration information through the application layer interface, thereby improving the convenience of batch-to-online file processing and facilitating the verification of batch-to-online files, thereby improving the efficiency of batch-to-online file processing.

[0030] In an optional embodiment, the parameter information further includes user identification information; after generating the multi-dimensional report based on the statistical information, the method further includes:

[0031] determining a target user according to the user identification information;

[0032] The multi-dimensional report is sent to a terminal device corresponding to the target user, so that the target user can view the multi-dimensional report through the terminal device.

[0033] The method of the above embodiment determines the target user based on the user identification information; sends the multidimensional report to the terminal device corresponding to the target user, so that the target user can view the multidimensional report through the terminal device. The user sets the transaction file configuration information through the application layer interface, further improving the convenience of batch-to-online file processing, making the verification of batch-to-online files more convenient, and further improving the efficiency of batch-to-online file processing.

[0034] In a second aspect, an embodiment of the present application further provides a batch-to-online file processing device, the device comprising:

[0035] a target file determination unit configured to obtain a target file identifier based on a target service identifier and preset transaction file configuration information; the target service identifier represents a range of services to be processed when converting batch files to online files; the transaction file configuration information includes a correspondence between the service identifier and the file identifier of the batch files to be converted to online files;

[0036] a path data generating unit, configured to obtain executable data corresponding to the target service identifier based on the target file identifier and file index information of the distributed system; the file index information including the file identifier of the batch-to-online file and the corresponding path information of the batch-to-online file; the executable data being the path information of the target batch-to-online file in the distributed system that needs to be processed when processing the batch-to-online file;

[0037] An information reading unit, configured to read data of the target batch-to-online file based on the executable data;

[0038] A data splicing unit is used to splice the read data to obtain target splicing information; the target splicing information includes the data of the target batch-converted online file;

[0039] The data reconstruction unit is used to obtain parsed data according to the target splicing information and preset business rules, and assemble the parsed data into summary information.

[0040] In an optional embodiment, the target file determination unit is specifically configured to:

[0041] If the monitoring reaches the next start time corresponding to the batch-to-online file processing task, the target file identifier is obtained according to the target business identifier and preset transaction file configuration information included in the parameter information of the batch-to-online file processing task.

[0042] In an optional embodiment, the device further includes:

[0043] A parameter configuration unit is used to obtain the batch-to-online file processing task set by the user before the monitoring reaches the next startup time corresponding to the batch-to-online file processing task; the parameter information of the batch-to-online file processing task includes the approved running time information and the target business identifier; the approved running time information is used to determine the next startup time for the batch-to-online file processing corresponding to the target business identifier.

[0044] In an optional embodiment, the parameter information further includes batch rules; the file index information further includes batch information corresponding to the batch-to-online files; and the path data generating unit is specifically configured to:

[0045] Obtaining the target query batch according to the batch rule and the next start time;

[0046] Retrieving the file index information of the distributed system based on the target file identifier and the target query batch to obtain target file index information;

[0047] According to the path information of the batch-to-online files contained in the target file index information, executable data corresponding to the target query batch and the target business identifier is generated.

[0048] In an optional embodiment, the apparatus further includes a report generating unit configured to:

[0049] In response to a report generation instruction input by a user, obtaining statistical information corresponding to the target business identifier based on the summary information;

[0050] Based on the statistical information, a multidimensional report is generated; the multidimensional report includes part or all of the following items: the business success rate corresponding to a single target business identifier, the business success rate corresponding to multiple target business identifiers, a business success rate trend chart corresponding to a single target business identifier in a target time period, and a data details table corresponding to multiple target business identifiers; the data details table includes the statistical data.

[0051] In an optional embodiment, the transaction file configuration information is set by the user through an application layer interface.

[0052] In an optional embodiment, the parameter information further includes user identification information; and the report generating unit is further configured to:

[0053] After generating a multi-dimensional report based on the statistical information, determining a target user according to the user identification information;

[0054] The multi-dimensional report is sent to a terminal device corresponding to the target user, so that the target user can view the multi-dimensional report through the terminal device.

[0055] In a third aspect, an embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the batch-to-online file processing method of the first aspect is implemented.

[0056] In a fourth aspect, an embodiment of the present application further provides an electronic device comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the computer program is executed by the processor, the processor implements the batch-to-online file processing method of the first aspect.

[0057] In a fifth aspect, an embodiment of the present application provides a computer program product, which includes computer instructions, and the computer instructions are stored in a computer-readable storage medium; when the processor of a computer device reads the computer instructions from the computer-readable storage medium, the processor executes the computer instructions, so that the computer device performs the steps of any one of the above-mentioned batch-to-online file processing methods.

[0058] The technical effects brought about by any one of the implementation methods in the second to fifth aspects can refer to the technical effects brought about by the implementation method in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0060] Figure 1 A flowchart of a method for batch-to-online file processing provided in an embodiment of the present application;

[0061] Figure 2 A schematic diagram of a process for obtaining executable data in a batch-to-online file processing method provided in an embodiment of the present application;

[0062] Figure 3 A schematic diagram of a process for generating multi-dimensional reports in a batch-to-online file processing method provided in an embodiment of the present application;

[0063] Figure 4 A schematic diagram of a multi-dimensional report generated by a batch-to-online file processing method provided in an embodiment of the present application;

[0064] Figure 5 A schematic diagram of the structure of a batch-to-online file processing device provided in an embodiment of the present application;

[0065] Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0066] To make the objectives, technical solutions, and advantages of this application more clear, this application will be further described in detail below with reference to the accompanying drawings. Obviously, the embodiments described are only some of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making any creative efforts are within the scope of protection of this application.

[0067] The following explains some of the terms used in the embodiments of the present application to facilitate understanding by those skilled in the art.

[0068] (1) Batch transfer to online (CC): Batch initiates requests to call online transaction operations, hereinafter referred to as CC.

[0069] (2) HDFS (Hadoop Distributed File System): HDFS is a distributed file system and a highly fault-tolerant system that provides high-throughput data access and is commonly used in large-scale data set applications.

[0070] (3) Partitioning: In order to improve the scalability and availability of the system, the data is divided into several parts and stored on different server nodes.

[0071] (4) HDFS API (Hadoop Distributed File System Application Programming Interface): HDFS API refers to the Java HDFS API. In the embodiments of the present application, operations such as data reading can be performed on HDFS files through the HDFS API.

[0072] In order to achieve efficient aggregation processing of batch-to-online files and improve the efficiency of batch-to-online file processing, the present application provides a batch-to-online file processing method and device. In order to better understand the technical solution provided by the present application embodiment, the basic principle of the solution is briefly explained here.

[0073] It should be noted that the terms "first," "second," and the like in the specification and claims of this application and the accompanying drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate so that the embodiments of the application described herein can be implemented in an order other than those illustrated or described herein. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

[0074] The technical solutions provided by the embodiments of the present application are described below with reference to the accompanying drawings.

[0075] Currently, in the operation of financial business systems, batch transfer to online business is inevitable, that is, batch initiation of requests to call online transaction operations.

[0076] Batch transfers generate multi-partitioned files. These files are divided into multiple partitions, and each partition file is further divided into multiple pieces, multiplying the data. The large number of files and the large amount of data in batch transfers create significant challenges for verification. Currently, batch transfers rely primarily on manual file identification, resulting in low processing efficiency.

[0077] In view of this, an embodiment of the present application provides a batch-to-online file processing method and device, wherein the batch-to-online file processing method can obtain a target file identifier based on a target business identifier and preset transaction file configuration information; the target business identifier represents the scope of business that needs to be processed when processing batch-to-online files; the transaction file configuration information includes the correspondence between the business identifier and the file identifier of the batch-to-online file; based on the target file identifier and the file index information of the distributed system, executable data corresponding to the target business identifier is obtained; the file index information includes the file identifier of the batch-to-online file and the path information of the corresponding batch-to-online file; the executable data is the path information of the target batch-to-online file that needs to be processed in the distributed system when processing the batch-to-online file; the data of the target batch-to-online file is read based on the executable data; the read data is spliced to obtain target splicing information; the target splicing information contains the data of the target batch-to-online file; according to the target splicing information and preset business rules, parsed data is obtained, and the parsed data is assembled into summary information. This method automatically retrieves the batch-to-online files that need to be analyzed, reads the contents of each batch-to-online file and splices them to obtain splicing information, and parses and assembles the splicing information according to preset business rules, thereby achieving efficient summary processing of the batch-to-online files, providing convenience for the verification of the batch-to-online files, and improving the efficiency of the batch-to-online file processing.

[0078] The preferred embodiments of the present application are described below in conjunction with the drawings in the specification. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present application and are not used to limit the present application. In addition, the embodiments and features in the embodiments of the present application can be combined with each other if there is no conflict.

[0079] The following further explains the batch conversion online file processing method provided by the embodiment of the present application. The batch conversion online file processing method provided by the present application is as follows: Figure 1 As shown, the following steps are included:

[0080] S101, obtaining a target file identifier according to a target business identifier and preset transaction file configuration information.

[0081] The target business identifier represents the scope of the business that needs to be processed when processing batch-to-online files; the transaction file configuration information includes the correspondence between the business identifier and the file identifier of the batch-to-online files.

[0082] For example, transaction file configuration information Info1 may be as shown in Table 1. As shown in Table 1, transaction file configuration information Info1 includes the business identifier "A01" and the file identifier "FT_01" for batch-to-online file transfer. Assuming the target business identifier is "A01," the target file identifier "FT_01" can be obtained based on transaction file configuration information Info1 shown in Table 1.

[0083] Table 1

[0084] Business Logo File identifiers for batch-converted online files A01 FT_01 A02 FT_02 A03 FT_03 … …

[0085] In an optional embodiment, the target file identifier is obtained based on the target business identifier and the preset transaction file configuration information. Specifically, if the monitoring reaches the next start time corresponding to the batch-to-online file processing task, the target file identifier is obtained based on the target business identifier and the preset transaction file configuration information included in the parameter information of the batch-to-online file processing task.

[0086] For example, assuming that there is a preset batch-to-online file processing task Task1, and the next startup time corresponding to Task1 is "December 10, 2021 09:00", the process of obtaining the target file identifier based on the target business identifier and the preset transaction file configuration information can be that if the monitoring reaches the next startup time corresponding to the batch-to-online file processing task Task1 "December 10, 2021 09:00", then according to the parameter information of the batch-to-online file processing task Task1 including the target business identifier "A01" and the preset transaction file configuration information shown in Table 1, the target file identifier is obtained, and the target file identifier is "FT_01".

[0087] In an optional embodiment, before monitoring the arrival of the next startup time corresponding to the batch-to-online file processing task, the batch-to-online file processing task set by the user is first obtained; the parameter information of the batch-to-online file processing task includes the approved running time information and the target business identifier; the approved running time information is used to determine the next startup time for the batch-to-online file processing corresponding to the target business identifier.

[0088] Exemplarily, before performing the batch-to-online file processing process based on the next start time "December 10, 2021 09:00" corresponding to the batch-to-online file processing task Task1, first obtain the batch-to-online file processing task Task1 set by the user, wherein the parameter information of the batch-to-online file processing task Task1 includes the approved running time information T_Info and the target business identifier "A01". Assuming that the approved running time information T_Info is "execution frequency: 1 time / day, time: 9:00", the approved running time information T_Info indicates that the execution time of the batch-to-online file processing task Task1 is 9:00 every day. According to the approved running time information T_Info "execution frequency: 1 time / day, time: 9:00", the next start time for the batch-to-online file processing corresponding to the target business identifier "A01" can be determined, for example, the next start time is "December 10, 2021 09:00".

[0089] It can be understood that in an embodiment of the present application, when the user sets a batch-to-online file processing task and starts it, the system can determine the next startup time of the batch-to-online file processing for the first time; during the duration of the batch-to-online file processing task, it also includes re-determining the next startup time of the batch-to-online file processing after each monitoring reaches the next startup time corresponding to the batch-to-online file processing task and performing the batch-to-online file processing process.

[0090] S102: Obtain executable data corresponding to the target service identifier according to the target file identifier and the file index information of the distributed system.

[0091] Among them, the file index information includes the file identifier of the batch-to-online file and the corresponding path information of the batch-to-online file; the executable data is the path information of the target batch-to-online file in the distributed system that needs to be processed when processing the batch-to-online file.

[0092] For example, the file index information of the distributed system can be found in Table 2. The file index information includes file identifiers of batch-converted online files and corresponding path information of the batch-converted online files. For example, in the file index information in Table 2, the file identifier FT_01 corresponds to the path information "Hdfs: / / 10.194.40.59:9000 / home / … / FCN.PRA.FEC.G03.A*"; the file identifier FT_02 corresponds to the path information "Hdfs: / / 10.194.30.56:9000 / home / … / FCN.PRB.FED.E02.B*"; and the file identifier FT_03 corresponds to the path information "Hdfs: / / 10.192.30.26:9000 / home / … / FCN.PRD.FEQ.Q01.C*".

[0093] Table 2

[0094]

[0095]

[0096] Taking the file index information in Table 2 as an example, assuming that the number of path information of the batch-to-online file corresponding to the file identifier "A01" is only one, according to the target file identifier "A01" and the file index information of the distributed system shown in Table 2, the executable data Res corresponding to the target business identifier "A01" is obtained, wherein the executable data Res includes the path information "Hdfs: / / 10.194.40.59:9000 / home / … / FCN.PRA.FEC.G03.A*" of the target batch-to-online file FT_01 that needs to be processed when processing the batch-to-online file in the distributed system.

[0097] In an optional embodiment, the parameter information also includes batch rules; the file index information also includes batch information corresponding to the batch-to-online files; according to the target file identifier and the file index information of the distributed system, the executable data corresponding to the target business identifier is obtained, such as Figure 2 As shown, this can be achieved by following the steps below:

[0098] S201, obtaining a target query batch according to batch rules and next startup time.

[0099] Exemplarily, as shown in Table 3, the file index information may also include batch information corresponding to the batch-to-online files. For example, the batch information "20211209" in Table 3 indicates that the batch-to-online files with the file identifier "FT_01" and the path information "Hdfs: / / 10.194.40.59:9000 / home / … / FCN.PRA.FEC.G03.A*" were generated on December 9, 2021. Similarly, the batch information "20211208" in Table 3 indicates that the batch-to-online files with the file identifier "FT_03" and the path information "Hdfs: / / 10.192.30.26:9000 / home / … / FCN.PRD.FEQ.Q01.C*" were generated on December 8, 2021.

[0100] Table 3

[0101]

[0102] Taking the file index information shown in Table 3 as an example, the parameter information of the batch-to-online file processing task Task1 also includes the batch rule Rule_Task1. Assume that the batch rule Rule_Task1 generates a corresponding query batch based on the day before the next startup time, and the format of the query batch is the same as the format of the batch information in the file index information. Take the batch rule Rule_Task1 and the next startup time "2021-12-10 09:00" as an example. The day before the next startup time "2021-12-10 09:00" is December 9, 2021. According to the batch rule Rule_Task1 and the next startup time "2021-12-10 09:00", the target query batch obtained can be "20211209".

[0103] S202: Retrieve the file index information of the distributed system based on the target file identifier and the target query batch to obtain the target file index information.

[0104] For example, based on the target file identifier "FT_01" and the target query batch "20211209", the file index information of the distributed system shown in Table 3 is retrieved, and the target file index information obtained is the "batch information, file identifier of batch-to-online files, path information of batch-to-online files" in Table 3, and the specific information is the index information of "20211209, FT_01, Hdfs: / / 10.194.40.59:9000 / home / … / FCN.PRA.FEC.G03.A*".

[0105] S203: Generate executable data corresponding to the target query batch and the target business identifier according to the path information of the batch-to-online files included in the target file index information.

[0106] For example, the target file index information retrieved is the "batch information, file identifier of batch-to-online files, path information of batch-to-online files" in Table 3, and the specific information is "20211209, FT_01, Hdfs: / / 10.194.40.59:9000 / home / … / FCN.PRA.FEC.G03.A*" as an example. According to the path information of batch-to-online files "Hdfs: / / 10.194.40.59" contained in the target file index information, :9000 / home / … / FCN.PRA.FEC.G03.A*”, generate executable data Res corresponding to the target query batch “20211209” and the target business identifier “A01”, wherein the executable data Res includes the path information “Hdfs: / / 10.194.40.59:9000 / home / … / FCN.PRA.FEC.G03.A*” of the target batch-to-online file FT_01 that needs to be processed when processing batch-to-online files in the distributed system.

[0107] S103, reading target batch-to-online file data based on the executable data.

[0108] In some optional embodiments, the data of the batch-converted online files is read through the JAVA HDFS API.

[0109] For example, based on the executable data Res, data of a target batch-to-online file with batch information of "20211209" and a file identifier of the batch-to-online file of "FT_01" can be read.

[0110] S104: performing splicing processing on the read data to obtain target splicing information.

[0111] The target splicing information includes target batch-converted online file data.

[0112] In a specific implementation, when multiple pieces of data of the target batch-to-online file are read, the read data can be spliced to obtain target splicing information, wherein the target splicing information includes the data of the target batch-to-online file.

[0113] S105 , obtaining parsed data according to the target splicing information and preset business rules, and assembling the parsed data into summary information.

[0114] During specific implementation, the target splicing information can be parsed according to the preset business rules based on the target splicing information and the preset business rules to obtain parsed data, and the parsed data can be assembled into summary information.

[0115] For example, the preset business rule could be "The first two characters of each data item in the target concatenated information: 01 indicates a successful transaction, 00 indicates a failed transaction; the third to tenth characters are the transaction description." Assuming the target business identifier is "A01" and the target query batch is "20211209," the number of data items retrieved is 3, of which 1 is a successful transaction, and the transaction description is "request exception," the summary information can be shown in Table 4:

[0116] Table 4

[0117] Business Logo Number of successful transactions Description Batch information A01 1 20211209 A01 0 Request exception 20211209 A01 0 Request exception 20211209

[0118] In an optional embodiment, the process of batch conversion to online file processing can also generate multi-dimensional reports, such as Figure 3 As shown, the process of generating a multidimensional report includes the following steps:

[0119] S301 , in response to a report generation instruction input by a user, obtain statistical information corresponding to a target business identifier according to summary information.

[0120] For example, in response to the report generation instruction input by the user, statistical information corresponding to the target business identifier "A01" is obtained according to the summary information shown in Table 4. For example, the statistical information may be as shown in Table 5.

[0121] Table 5

[0122]

[0123] S302: Generate a multi-dimensional report based on the statistical information.

[0124] Among them, the multidimensional report includes part or all of the following items: the business success rate corresponding to a single target business identifier, the business success rate corresponding to multiple target business identifiers, the business success rate trend chart corresponding to a single target business identifier in the target time period, and the data details table corresponding to multiple target business identifiers; the data details table includes statistical data.

[0125] For example, based on the statistical information, a multi-dimensional report can be generated. The multi-dimensional report can be the business success rate corresponding to a single target business identifier, the business success rate corresponding to multiple target business identifiers, a business success rate trend chart corresponding to a single target business identifier in a target time period, and a data detail table corresponding to multiple target business identifiers; the data detail table includes statistical data. Among them, the business success rate corresponding to a single target business identifier can be as follows: Figure 4 As shown, the data details table corresponding to multiple target service identifiers can be shown in Table 5.

[0126] In an optional embodiment, the transaction file configuration information is set by the user through an application layer interface.

[0127] By setting transaction file configuration information through the application layer interface, users can improve the convenience of batch-to-online file processing and facilitate the verification of batch-to-online files, thereby improving the efficiency of the summary processing of batch-to-online files.

[0128] In an optional embodiment, the parameter information further includes user identification information; after generating the multi-dimensional report based on the statistical information, the method further includes:

[0129] Determine the target user based on the user identification information;

[0130] The multidimensional report is sent to a terminal device corresponding to a target user, so that the target user can view the multidimensional report through the terminal device.

[0131] Determine the target user based on user identification information; send the multidimensional report to the terminal device corresponding to the target user, so that the target user can view the multidimensional report through the terminal device. The user sets the transaction file configuration information through the application layer interface, which can further improve the convenience of batch-to-online file processing, make the verification of batch-to-online files more convenient, and further improve the efficiency of the summary processing of batch-to-online files.

[0132] The batch-to-online file processing method provided in the above embodiment can obtain a target file identifier based on a target business identifier and preset transaction file configuration information; obtain executable data corresponding to the target business identifier based on the target file identifier and file index information of a distributed system; read the data of the target batch-to-online file based on the executable data; splice the read data to obtain target splicing information; obtain parsed data based on the target splicing information and preset business rules, and assemble the parsed data into summary information. This method achieves efficient summary processing of batch-to-online files, thereby improving the efficiency of summary processing of batch-to-online files.

[0133] Based on the same inventive concept, the present application also provides a batch-to-online file processing device. Since this device corresponds to the batch-to-online file processing method of the present application and solves the problem in a similar manner to the method, the implementation of this device can refer to the implementation of the aforementioned method, and the repeated parts will not be repeated here.

[0134] Figure 5The schematic diagram of the structure of a batch-to-online file processing device provided by the embodiment of the present application is shown. Figure 5 As shown, it includes: a target file determination unit 501, a path data generation unit 502, an information reading unit 503, a data splicing unit 504 and a data reconstruction unit 505.

[0135] The target file determination unit 501 is configured to obtain a target file identifier based on a target business identifier and preset transaction file configuration information; the target business identifier represents the scope of the business to be processed when converting batch files to online files; the transaction file configuration information includes a correspondence between the business identifier and the file identifier of the batch files to be converted to online files;

[0136] The path data generating unit 502 is configured to obtain executable data corresponding to the target service identifier based on the target file identifier and file index information of the distributed system; the file index information includes the file identifier of the batch-to-online file and the corresponding path information of the batch-to-online file; the executable data is the path information of the target batch-to-online file in the distributed system that needs to be processed when processing the batch-to-online file;

[0137] An information reading unit 503 is configured to read data of a target batch-to-online file based on the executable data;

[0138] The data splicing unit 504 is used to splice the read data to obtain target splicing information; the target splicing information includes the data of the target batch-to-online file;

[0139] The data reconstruction unit 505 is used to obtain parsed data according to the target splicing information and preset business rules, and assemble the parsed data into summary information.

[0140] In an optional embodiment, the target file determination unit 501 is specifically configured to:

[0141] If the monitoring reaches the next start time corresponding to the batch-to-online file processing task, the target file identifier is obtained according to the target business identifier and preset transaction file configuration information included in the parameter information of the batch-to-online file processing task.

[0142] In an optional embodiment, the batch-to-online file processing device further includes:

[0143] The parameter configuration unit 506 is used to obtain the batch-to-online file processing task set by the user before monitoring the arrival of the next startup time corresponding to the batch-to-online file processing task; the parameter information of the batch-to-online file processing task includes the approved running time information and the target business identifier; the approved running time information is used to determine the next startup time for the batch-to-online file processing corresponding to the target business identifier.

[0144] In an optional embodiment, the parameter information further includes batch rules; the file index information further includes batch information corresponding to the batch-to-online files; the path data generating unit 502 is specifically configured to:

[0145] According to the batch rules and the next start time, the target query batch is obtained;

[0146] Retrieve the file index information of the distributed system based on the target file identifier and the target query batch to obtain the target file index information;

[0147] According to the path information of the batch-to-online files contained in the target file index information, executable data corresponding to the target query batch and the target business identifier is generated.

[0148] In an optional embodiment, the batch-to-online file processing apparatus further includes a report generating unit 507, which is configured to:

[0149] In response to a report generation instruction input by a user, statistical information corresponding to a target business identifier is obtained based on the summary information;

[0150] Generate multidimensional reports based on statistical information; the multidimensional reports include some or all of the following items: the business success rate corresponding to a single target business identifier, the business success rate corresponding to multiple target business identifiers, the business success rate trend chart corresponding to a single target business identifier in the target time period, and the data details table corresponding to multiple target business identifiers; the data details table includes statistical data.

[0151] In an optional embodiment, the transaction file configuration information is set by the user through an application layer interface.

[0152] In an optional embodiment, the parameter information further includes user identification information; and the report generating unit 507 is further configured to:

[0153] After generating a multi-dimensional report based on statistical information, target users are determined based on user identification information;

[0154] The multidimensional report is sent to a terminal device corresponding to a target user, so that the target user can view the multidimensional report through the terminal device.

[0155] Based on the same inventive concept as the above method embodiment, an electronic device is also provided in the embodiment of the present application. The electronic device can be used for batch conversion of online files. In one embodiment, the electronic device can be a server. In this embodiment, the structure of the electronic device can be as follows: Figure 6 As shown, it includes a memory 601 , a communication module 603 and one or more processors 602 .

[0156] Memory 601 is used to store computer programs executed by processor 602. Memory 601 may mainly include a program storage area and a data storage area. The program storage area may store an operating system and programs required for running instant messaging functions, while the data storage area may store various instant messaging messages and operating instruction sets.

[0157] Memory 601 may be a volatile memory, such as random-access memory (RAM); a non-volatile memory, such as read-only memory, flash memory, a hard disk drive (HDD), or a solid-state drive (SSD); or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited thereto. Memory 601 may be a combination of the above memories.

[0158] The processor 602 may include one or more central processing units (CPUs) or digital processing units, etc. The processor 602 is configured to implement the above-mentioned batch file conversion method when calling the computer program stored in the memory 601 .

[0159] The communication module 603 is used to communicate with electronic devices and other terminals or servers.

[0160] The specific connection medium between the memory 601, the communication module 603 and the processor 602 is not limited in the embodiment of the present application. Figure 6 In the embodiment, the memory 601 and the processor 602 are connected via a bus 604. Figure 6 The connections between the other components are shown in bold lines, which are only for illustration and are not intended to be limiting. The bus 604 can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, Figure 6 Only one thick line is used in the diagram, but this does not mean that there is only one bus or one type of bus.

[0161] An embodiment of the present application further provides a computer storage medium, in which computer executable instructions are stored. The computer executable instructions are used to implement the batch-to-online file processing method described in any embodiment of the present application.

[0162] Embodiments of the present application further provide a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. When a processor of a computer device reads the computer instructions from the computer-readable storage medium, the processor executes the computer instructions, causing the computer device to perform the batch file conversion method described in any of the above embodiments.

[0163] The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0164] The above is only a specific implementation method of the present application, but the scope of protection of the present application is not limited thereto. Any technician familiar with this technical field can easily think of changes or replacements within the technical scope disclosed in this application, which should be covered by the scope of protection of the present application.

Claims

1. A method for processing batch files for online transfer, characterized in that: The method comprises: Obtaining a target file identifier based on a target service identifier and preset transaction file configuration information; the target service identifier represents a range of services to be processed when processing batch files for online conversion; the transaction file configuration information includes a correspondence between the service identifier and the file identifier of the batch files for online conversion; Obtaining executable data corresponding to the target service identifier based on the target file identifier and file index information of the distributed system; the file index information includes the file identifier of the batch-to-online file and corresponding path information of the batch-to-online file; the executable data is path information of the target batch-to-online file in the distributed system that needs to be processed when processing the batch-to-online file; Reading data of the target batch-to-online file based on the executable data; Splicing the read data to obtain target splicing information; the target splicing information includes the data of the target batch-converted online file; According to the target splicing information and preset business rules, parsed data is obtained, and the parsed data is assembled into summary information.

2. The method according to claim 1, characterized in that The step of obtaining the target file identifier based on the target business identifier and the preset transaction file configuration information includes: If the monitoring reaches the next start time corresponding to the batch-to-online file processing task, the target file identifier is obtained according to the target business identifier and preset transaction file configuration information included in the parameter information of the batch-to-online file processing task.

3. The method according to claim 2, characterized in that Before the monitoring reaches the next start time corresponding to the batch-to-online file processing task, the method further includes: Obtain the batch-to-online file processing task set by the user; the parameter information of the batch-to-online file processing task includes the approved running time information and the target business identifier; the approved running time information is used to determine the next startup time for the batch-to-online file processing corresponding to the target business identifier.

4. The method according to claim 2, characterized in that The parameter information also includes batch rules; the file index information also includes batch information corresponding to the batch-to-online files; and obtaining executable data corresponding to the target service identifier based on the target file identifier and the file index information of the distributed system includes: Obtaining a target query batch according to the batch rule and the next start time; Retrieving the file index information of the distributed system based on the target file identifier and the target query batch to obtain target file index information; According to the path information of the batch-to-online files contained in the target file index information, executable data corresponding to the target query batch and the target business identifier is generated.

5. The method according to claim 3, characterized in that The method further comprises: In response to a report generation instruction input by a user, obtaining statistical information corresponding to the target business identifier based on the summary information; Based on the statistical information, a multidimensional report is generated; the multidimensional report includes part or all of the following items: the business success rate corresponding to a single target business identifier, the business success rate corresponding to multiple target business identifiers, a business success rate trend chart corresponding to a single target business identifier in a target time period, and a data details table corresponding to multiple target business identifiers; the data details table includes the statistical data.

6. A batch-to-online file processing device, characterized in that: The device comprises: a target file determination unit configured to obtain a target file identifier based on a target service identifier and preset transaction file configuration information; the target service identifier represents a range of services to be processed when converting batch files to online files; the transaction file configuration information includes a correspondence between the service identifier and the file identifier of the batch files to be converted to online files; a path data generating unit, configured to obtain executable data corresponding to the target service identifier based on the target file identifier and file index information of the distributed system; the file index information including the file identifier of the batch-to-online file and the corresponding path information of the batch-to-online file; the executable data being the path information of the target batch-to-online file in the distributed system that needs to be processed when processing the batch-to-online file; An information reading unit, configured to read data of the target batch-to-online file based on the executable data; A data splicing unit is used to splice the read data to obtain target splicing information; the target splicing information includes the data of the target batch-converted online file; The data reconstruction unit is used to obtain parsed data according to the target splicing information and preset business rules, and assemble the parsed data into summary information.

7. The device according to claim 6, characterized in that The target file determination unit is specifically configured to: If the monitoring reaches the next start time corresponding to the batch-to-online file processing task, the target file identifier is obtained according to the target business identifier and preset transaction file configuration information included in the parameter information of the batch-to-online file processing task.

8. The device according to claim 7, characterized in that The device further comprises: A parameter configuration unit is used to obtain the batch-to-online file processing task set by the user before the monitoring reaches the next startup time corresponding to the batch-to-online file processing task; the parameter information of the batch-to-online file processing task includes the approved running time information and the target business identifier; the approved running time information is used to determine the next startup time for the batch-to-online file processing corresponding to the target business identifier.

9. The device according to claim 7, characterized in that The parameter information also includes batch rules; the file index information also includes batch information corresponding to the batch-to-online files; the path data generation unit is specifically configured to: Obtaining a target query batch according to the batch rule and the next start time; Retrieving the file index information of the distributed system based on the target file identifier and the target query batch to obtain target file index information; According to the path information of the batch-to-online files contained in the target file index information, executable data corresponding to the target query batch and the target business identifier is generated.

10. The device according to claim 8, characterized in that The device also includes a report generating unit, which is used to: In response to a report generation instruction input by a user, obtaining statistical information corresponding to the target business identifier based on the summary information; Generate a multidimensional report based on the statistical information; The multi-dimensional report includes part or all of the following items: the business success rate corresponding to a single target business identifier, the business success rate corresponding to multiple target business identifiers, a business success rate trend chart corresponding to a single target business identifier in a target time period, and a data detail table corresponding to multiple target business identifiers; The data details table includes the statistical data.

11. A computer-readable storage medium storing a computer program, wherein: When the computer program is executed by a processor, the method according to any one of claims 1 to 5 is implemented.

12. An electronic device, characterized in that: The method comprises a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the computer program is executed by the processor, the method according to any one of claims 1 to 5 is implemented.

13. A computer program product, characterized in that It includes computer instructions, which are stored in a computer-readable storage medium; when a processor of a computer device reads the computer instructions from the computer-readable storage medium, the processor executes the computer instructions, so that the computer device performs the steps of any method in claims 1 to 5.

Images