Business Data Batch Processing Method and Device

By dividing and merging business data sets, the problems of incomplete and inconsistent data in batch processing were solved, the automation of batch processing was achieved, the accuracy and completeness of data were improved, the statistical needs based on natural dates were met, and human resources were saved.

CN117194451BActive Publication Date: 2026-01-06CHINA CONSTRUCTION BANK
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202311161771.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-09-08
Publication Date
2026-01-06
Estimated Expiration
2043-09-08

AI Technical Summary

Technical Problem

During batch data processing, issues such as incomplete or inconsistent data, as well as the need for manual intervention to supplement data, exist, affecting the accuracy and completeness of the data. This is particularly true when performing statistics based on natural dates, where existing technologies have failed to effectively address these problems.

Method used

By receiving data processing requests from upstream business systems, business data is divided according to the batch date and the actual occurrence date, forming first and second data sets, which are then merged and processed separately to ensure data integrity and accuracy.

Benefits of technology

It improves the completeness and accuracy of business data, meets the statistical needs based on natural dates, saves human resources, and solves the problems of incomplete and inconsistent data.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117194451B_ABST
    Figure CN117194451B_ABST
Patent Text Reader

Abstract

The application discloses a kind of service data batch processing method and device, the method includes: receiving the service data processing request that upstream service system issues, according to the data batch date corresponding to batch to-be-processed service data, the actual occurrence date of each to-be-processed service data, batch to-be-processed service data is divided, obtains first data set and second data set;First data set is merged with first staging data set, obtains first complete data set;The service data in first complete data set is processed, obtains first service data processing result;Second data set is staged, obtains second staging data set, to be merged with the data set of the same actual occurrence date of service data in second staging data set, obtains second complete data set, the service data in second complete data set is processed, obtains second service data processing result, can improve the integrity and accuracy of service data.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer data processing, and in particular to a business data batch processing method and device. BACKGROUND

[0002] This section is intended to provide background information to facilitate an understanding of embodiments of the application as set forth in the claims. The description herein does not constitute admission of prior art.

[0003] In the data batch processing process, for the data provider, due to the time cost of data processing, in order to meet the timeliness requirement of data provision, the data processing may need to be processed in advance relative to the natural date, for example:

[0004] The data provision time agreed by the data provider and the data receiver is T day 24:00, the data processing of the data provider needs 30 minutes, and the data provider needs to start data processing at 23:30 of T day, so the data provided by the data provider on the data batch date T only contains the business data of [0:00, 23:30] of the natural date T, and the business data of [23:30, 24:00] is usually provided in the data batch date T+1. Therefore, the business data in the natural day is incomplete in the batch processing, which affects the completeness of the data processing and integration of the data receiver, and if the integrated data needs to be provided to the subsequent downstream components / systems, manual intervention may be needed to supplement the completeness of the data record; if the integrated data is used for daily index statistics, the index statistics may be inaccurate.

[0005] In the data batch processing process, for multiple data providers, due to the difference in data processing time of the system, the data of multiple data providers in the data batch may not be completely consistent in the time period, for example:

[0006] The business data time range of the data provider A in the data batch date T is [0:00, 23:45], and the business data time range of the data provider B in the data batch date T is [0:00, 23:30], so when the data receiver integrates the data of the data provider A and the data provider B, the data of A and B may not be correctly associated for the business occurring in [23:30, 23:45]. Therefore, the data receiver cannot correctly associate the data when integrating the data, and there is a problem of missing data fields in the integrated data from B, and if the integrated data needs to be provided to the subsequent downstream components / systems, manual intervention may be needed to supplement the missing data fields.

[0007] Furthermore, since normal batch transaction processing inherently carries the possibility of data gaps, processing business data by batch (day T) may result in incomplete data processing based on calendar days. This could lead to incomplete statistics based on calendar days or incomplete reporting to downstream systems or regulators based on calendar days. Additionally, since batch processing is mostly automated at night, data issues on a given day may not be discovered until the following day, requiring manpower for data correction after batch processing is complete.

[0008] There is currently no effective solution to the above problems. Summary of the Invention

[0009] This invention provides a batch processing method for business data to improve the integrity and accuracy of business data, ensure the consistency of business data over time periods, meet the rigid requirements of some regulatory authorities for data segmentation and periodic statistical reporting based on natural dates, and save human resources. The method includes:

[0010] Receive a business data processing request from an upstream business system. The business data processing request includes: a batch of business data to be processed, and the data batch date corresponding to the batch of business data to be processed. Each piece of business data to be processed carries a data identifier, which represents the actual occurrence date of each piece of business data to be processed.

[0011] Based on the batch date of the business data to be processed and the actual occurrence date of each piece of business data to be processed, the batch of business data to be processed is divided into a first data set and a second data set; wherein, the actual occurrence date of the business data in the first data set is different from the batch date, while the actual occurrence date of the business data in the second data set is the same as the batch date;

[0012] The first data set and the first temporary data set are merged to obtain the first complete data set; the business data in the first complete data set is processed to obtain the first business data processing result, wherein the data batch date of the business data in the first temporary data set is the same as the actual occurrence date of the business data in the first data set;

[0013] The second data set is temporarily stored to obtain a second temporary data set, which is then merged with the data set containing the business data in the second temporary data set that has the same actual occurrence date to obtain a second complete data set. The business data in the second complete data set is then processed to obtain the second business data processing result.

[0014] This invention also provides a business data batch processing device to improve the integrity and accuracy of business data, save human resources, and meet the rigid requirements of some regulators for data segmentation and periodic statistical reporting based on natural dates. The device includes:

[0015] The business data processing request receiving module is used to receive business data processing requests sent by the upstream business system. The business data processing request includes: batch of business data to be processed, and the data batch date corresponding to the batch of business data to be processed. Each piece of business data to be processed carries a data identifier, which represents the actual occurrence date of each piece of business data to be processed.

[0016] The business data partitioning module is used to partition the batch of business data to be processed according to the data batch date corresponding to the batch of business data and the actual occurrence date of each piece of business data to be processed, to obtain a first data set and a second data set; wherein, the actual occurrence date of the business data in the first data set is different from the data batch date, while the actual occurrence date of the business data in the second data set is the same as the data batch date;

[0017] The first merging and processing module is used to merge the first data set and the first temporary data set to obtain the first complete data set; process the business data in the first complete data set to obtain the first business data processing result, wherein the data batch date of the business data in the first temporary data set is the same as the actual occurrence date of the business data in the first data set;

[0018] The second merging and processing module is used to temporarily store the second data set to obtain a second temporary data set, which is to be merged with the data set with the same actual occurrence date as the business data in the second temporary data set to obtain a second complete data set. The module then processes the business data in the second complete data set to obtain the second business data processing result.

[0019] This invention also provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the above-described business data batch processing method.

[0020] This invention also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described business data batch processing method.

[0021] This invention also provides a computer program product, which includes a computer program that, when executed by a processor, implements the above-described business data batch processing method.

[0022] In this embodiment of the invention, a business data processing request is received from an upstream business system. The business data processing request includes: a batch of business data to be processed, and the corresponding batch date of the business data to be processed. Each piece of business data to be processed carries a data identifier representing the actual occurrence date of each piece of business data. Based on the corresponding batch date and the actual occurrence date of each piece of business data to be processed, the batch of business data to be processed is divided into a first data set and a second data set. The actual occurrence date of the business data in the first data set is different from the batch date, while the actual occurrence date of the business data in the second data set is different. The actual occurrence date of the business data is the same as the batch date of the data; the first data set and the first temporary data set are merged to obtain the first complete data set; the business data in the first complete data set is processed to obtain the first business data processing result, wherein the batch date of the business data in the first temporary data set is the same as the actual occurrence date of the business data in the first data set; the second data set is temporarily stored to obtain the second temporary data set, which is to be merged with the data set with the same actual occurrence date as the business data in the second temporary data set to obtain the second complete data set, and the business data in the second complete data set is processed to obtain the second business data processing result.

[0023] This invention addresses business scenarios where there is some tolerance for the timeliness of batch processing of business data. It solves the problems of incomplete data supply and inconsistent time periods from upstream components / systems by delaying data batch processing, thereby improving the integrity and accuracy of business data, ensuring consistency of business data in terms of time periods, saving human resources, and meeting the rigid requirements of some regulators for data segmentation and periodic statistical reporting based on natural dates. Attached Figure Description

[0024] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort. In the drawings:

[0025] Figure 1 This is a flowchart of the business data batch processing method in an embodiment of the present invention;

[0026] Figure 2 This is a flowchart of a method for dividing batches of business data to be processed in an embodiment of the present invention;

[0027] Figure 3This is a schematic diagram of the business data batch processing device in an embodiment of the present invention;

[0028] Figure 4 This is a schematic diagram of a specific example of the business data batch processing device in an embodiment of the present invention;

[0029] Figure 5 This is a schematic diagram of a computer device structure according to an embodiment of the present invention. Detailed Implementation

[0030] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the embodiments of the present invention will be further described in detail below with reference to the accompanying drawings. Here, the illustrative embodiments of the present invention and their descriptions are used to explain the present invention, but are not intended to limit the present invention.

[0031] First, the technical terms used in the embodiments of this invention will be introduced:

[0032] Data batch date: When exchanging batch data between different business components (systems), it is agreed to supply data at a certain frequency, commonly on a daily basis. Therefore, the data batch is identified by date. This patent defines this date as the data batch date.

[0033] Business data date: For data in a batch, the actual occurrence date of the business data may be distributed across different natural dates. Therefore, in the batch exchanged data, each data item will be identified by the actual natural date on which the data occurred.

[0034] Data batch processing: Currently, for data processing processes with large volumes of business data, batch data exchange is usually used. After the data receiving party integrates data from multiple data suppliers, the data is then processed uniformly to generate various statistical indicators or integrated data as required.

[0035] Figure 1 This is a flowchart illustrating the batch processing method for business data in an embodiment of the present invention. Figure 1 As shown, the business data batch processing method in this embodiment of the invention may include:

[0036] Step 101: Receive a business data processing request from the upstream business system. The business data processing request includes: a batch of business data to be processed, and the data batch date corresponding to the batch of business data to be processed. Each piece of business data to be processed carries a data identifier, which represents the actual occurrence date of each piece of business data to be processed.

[0037] Step 102: Based on the batch date of the business data to be processed and the actual occurrence date of each piece of business data to be processed, divide the batch of business data to be processed into a first data set and a second data set; wherein, the actual occurrence date of the business data in the first data set is different from the batch date, and the actual occurrence date of the business data in the second data set is the same as the batch date.

[0038] Step 103: Merge the first data set with the first temporary data set to obtain the first complete data set; process the business data in the first complete data set to obtain the first business data processing result, wherein the data batch date of the business data in the first temporary data set is the same as the actual occurrence date of the business data in the first data set;

[0039] Step 104: Temporarily store the second data set to obtain a second temporary data set, which will be merged with the data set with the same actual occurrence date as the business data in the second temporary data set to obtain a second complete data set. Then, process the business data in the second complete data set to obtain the second business data processing result.

[0040] The specific execution steps of the business data batch processing method in this embodiment of the invention are described below:

[0041] It should be noted that the business data batch processing method in this invention is a scheme for delaying processing based on the batch date of data in business batch processing scenarios where there is a certain tolerance for business timeliness. It is applied to the data receiver to solve business scenarios where the system switching date may differ from the natural date in business batch processing, thereby meeting the needs of business scenarios such as statistical risk indicators based on natural days, data supply to downstream businesses based on natural days, and data reporting to regulators based on natural days.

[0042] First, step 101 can be executed: receive a business data processing request from the upstream business system. The business data processing request may include: a batch of business data to be processed, and the data batch date corresponding to the batch of business data to be processed. Each piece of business data to be processed carries a data identifier, which represents the actual occurrence date of each piece of business data to be processed.

[0043] In practice, there can be one or more upstream business systems. For example, the data receiver can simultaneously integrate business data from multiple business systems, process it, and then send it to the downstream business system.

[0044] In one embodiment, the data batch date is determined based on the data supply frequency pre-agreed with the upstream business system; the data occurrence date refers to the natural date on which the business data actually occurs.

[0045] In practice, for example, if the data recipient and the upstream business system pre-agree on a data supply frequency of once a day at 24:00, then when providing business data on date T to the data recipient, the data batch date of that batch of business data can be determined to be T.

[0046] In actual execution, the upstream business system needs to process the business data before providing it according to the data batch date. If the upstream business system needs 30 minutes to process the data, it needs to start processing the data at 23:30 on day T. Therefore, the data provided by the upstream business system in the data batch date T only includes the business data that actually occurred on the natural date T [0:00, 23:30], while the business data [23:30, 24:00] is usually provided in the data batch date T+1.

[0047] Then, step 102 can be executed: based on the data batch date corresponding to the batch of business data to be processed and the actual occurrence date of each piece of business data to be processed, the batch of business data to be processed is divided to obtain a first data set and a second data set; wherein, the actual occurrence date of the business data in the first data set is different from the data batch date, and the actual occurrence date of the business data in the second data set is the same as the data batch date.

[0048] Figure 2 This is a flowchart illustrating a method for dividing batches of business data to be processed, as described in an embodiment of the present invention. Figure 2 As shown, in one embodiment, the batch of business data to be processed is divided according to the data batch date corresponding to the batch of business data to be processed and the actual occurrence date of each piece of business data to be processed, to obtain a first data set and a second data set, which may include:

[0049] Step 201: Compare the batch date of the business data to be processed with the actual occurrence date of each piece of business data to be processed;

[0050] Step 202: Based on the comparison results, divide the batch of business data to be processed into a first data set and a second data set.

[0051] In one embodiment, the batch of business data to be processed is divided into a first data set and a second data set based on the comparison results. This may include: when the comparison results are consistent, the corresponding business data to be processed is assigned to the first data set; when the comparison results are inconsistent, the corresponding business data to be processed is assigned to the second data set.

[0052] After dividing the batch of business data to be processed into a first data set and a second data set, in order to obtain a complete and date-accurate business data set, steps 103-104 can be executed to process the first data set and the second data set respectively.

[0053] In step 103, the first data set and the first temporary data set can be merged to obtain the first complete data set; the business data in the first complete data set is processed to obtain the first business data processing result, wherein the data batch date of the business data in the first temporary data set is the same as the actual occurrence date of the business data in the first data set.

[0054] In practice, the first temporary data set includes previously temporary business data. The batch date and the actual occurrence date of these temporary business data are the same, and they are also the same as the actual occurrence date of the business data in the first data set. Therefore, merging the two can yield the complete business data for the actual occurrence date, which is the first complete data set.

[0055] In step 104, the second data set can be temporarily stored to obtain a second temporary data set, which is then merged with the data set with the same actual occurrence date as the business data in the second temporary data set to obtain a second complete data set. The business data in the second complete data set is then processed to obtain the second business data processing result.

[0056] In practice, although the actual occurrence date of the business data in the second data set is the same as the data batch date, as can be seen from the above example, this part of the data is incomplete. For example, the business data of [23:30, 24:00] is usually provided in the next data batch date. Therefore, the business data in the second data set can be temporarily stored until it is merged with the other business data with the same actual occurrence date to obtain the complete business data of that actual occurrence date, that is, the second complete data set.

[0057] In one embodiment, after obtaining the first business data processing result and the second business data processing result, the method may further include: sending the first business data processing result and the second business data processing result to a downstream business system or management system.

[0058] The following example illustrates the batch processing method for business data of this invention:

[0059] (1) If the business data provided by all upstream business systems has a business meaning related to the date of the business transaction, a data identifier needs to be established in advance for each piece of business data to represent which natural day the transaction actually occurred; when the data receiver receives a batch of business data with a data batch date of day T from an upstream business system, the data is processed as follows:

[0060] Assume that there is a data set F in the batch data file. T The data with index 0x belongs to the data whose business occurred on date T-1, and the data with index 1x belongs to the data whose business occurred on date T.

[0061] F T ={X 01 X 02 X 03 , ..., X 0n X 11 X 12 X 13 , ..., X 1m}

[0062] Decompose into two sets

[0063] C T-1 ={X 01 X 02 X 03 , ..., X 0n}

[0064] C T ={X 11 X 12 X 13 , ..., X 1m}

[0065] Where C T-1 Data merged into F T-1 The data is merged, C T Data temporary storage;

[0066] (2) When all business batches of data dated T+1 are received, the data of the same business components as in (1)1 are processed as follows:

[0067] Assume that there is a data set F in the batch data file. T+1 The data with index 1x belongs to the data whose business occurred on date T, and the data with index 2x belongs to the data whose business occurred on date T+1.

[0068] F T+1 ={X 1(n+1) X 1(n+2) X1 (n+3) , ..., X 1pX 21 X 22 X 23 , ..., X 2q}

[0069] Decomposed into two sets

[0070] C T ={X 1(n+1) X 1(n+2) X1 (n+3) , ..., X 1p}

[0071] C T+1 ={,X 21 X 22 X 23 , ..., X 2q}

[0072] C in 1) T C in 2) T Merge into one F ’ T The new set F ’ T

[0073] F ’ T ={X 11 X 12 X 13 , ..., X 1p}

[0074] (3) Repeat (1)-(2) to process all data files where the batch date of the data may be inconsistent with the date of the data within them;

[0075] (4) After the data of all upstream business components / systems expires on the business batch date T+1, the receiving party performs data preprocessing according to the methods 1)-3) and then completes the processing of its own business batch date T.

[0076] (5) After processing, generate statistical indicators based on natural day T or provide batch data exchange files to downstream businesses / regulatory departments to ensure the integrity of the basic data based on natural day T and the integrity and correctness of statistical processing based on natural day.

[0077] This invention also provides a business data batch processing apparatus, as described in the following embodiments. Since the principle by which this apparatus solves the problem is similar to that of the business data batch processing method, the implementation of this apparatus can refer to the implementation of the business data batch processing method; repeated details will not be elaborated further.

[0078] Figure 3This is a schematic diagram of the business data batch processing device in an embodiment of the present invention. Figure 3 As shown, the business data batch processing device in this embodiment of the invention may specifically include:

[0079] The business data processing request receiving module 301 is used to receive a business data processing request sent by the upstream business system. The business data processing request includes: a batch of business data to be processed, and the data batch date corresponding to the batch of business data to be processed. Each piece of business data to be processed carries a data identifier, which represents the actual occurrence date of each piece of business data to be processed.

[0080] The business data partitioning module 302 is used to partition the batch of business data to be processed according to the data batch date corresponding to the batch of business data and the actual occurrence date of each piece of business data to be processed, to obtain a first data set and a second data set; wherein, the actual occurrence date of the business data in the first data set is different from the data batch date, and the actual occurrence date of the business data in the second data set is the same as the data batch date;

[0081] The first merging and processing module 303 is used to merge the first data set and the first temporary data set to obtain the first complete data set; process the business data in the first complete data set to obtain the first business data processing result, wherein the data batch date of the business data in the first temporary data set is the same as the actual occurrence date of the business data in the first data set;

[0082] The second merging and processing module 304 is used to temporarily store the second data set to obtain a second temporary data set, which is to be merged with the data set with the same actual occurrence date as the business data in the second temporary data set to obtain a second complete data set, and to process the business data in the second complete data set to obtain the second business data processing result.

[0083] In one embodiment, the data batch date is determined based on a pre-agreed data supply frequency with the upstream business system; the data occurrence date refers to the natural date on which the business data actually occurs.

[0084] In one embodiment, the business data partitioning module 302 is specifically used for:

[0085] Compare the batch date of the business data to be processed with the actual occurrence date of each piece of business data to be processed;

[0086] Based on the comparison results, the batch of business data to be processed is divided into a first data set and a second data set.

[0087] In one embodiment, the business data partitioning module 302 is specifically used for:

[0088] If the comparison results are consistent, the corresponding business data to be processed will be assigned to the first data set;

[0089] When the comparison results are inconsistent, the corresponding business data to be processed will be divided into the second data set.

[0090] Figure 4 This is a schematic diagram of a specific example of a business data batch processing device in an embodiment of the present invention. For example... Figure 4 As shown in the embodiment, Figure 3 The business data batch processing device shown may further include:

[0091] Transmitting module 401, used for:

[0092] The results of the first and second business data processing are sent to the downstream business system or management system.

[0093] Based on the aforementioned inventive concept, such as Figure 5 As shown, the present invention also proposes a computer device 500, including a memory 510, a processor 520, and a computer program 530 stored in the memory 510 and executable on the processor 520. When the processor 520 executes the computer program 530, it implements the aforementioned business data batch processing method.

[0094] This invention also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described business data batch processing method.

[0095] This invention also provides a computer program product, which includes a computer program that, when executed by a processor, implements the above-described business data batch processing method.

[0096] In summary, in this embodiment of the invention, a business data processing request is received from an upstream business system. The business data processing request includes: a batch of business data to be processed, and the corresponding batch date of the business data to be processed. Each piece of business data to be processed carries a data identifier representing the actual occurrence date of each piece of business data. Based on the corresponding batch date and the actual occurrence date of each piece of business data to be processed, the batch of business data to be processed is divided into a first data set and a second data set. The actual occurrence date of the business data in the first data set is different from the batch date, and the second data set... The actual occurrence date of the business data is the same as the data batch date. The first data set and the first temporary data set are merged to obtain the first complete data set. The business data in the first complete data set is processed to obtain the first business data processing result, wherein the data batch date of the business data in the first temporary data set is the same as the actual occurrence date of the business data in the first data set. The second data set is temporarily stored to obtain the second temporary data set, which is to be merged with the data set with the same actual occurrence date as the business data in the second temporary data set to obtain the second complete data set. The business data in the second complete data set is then processed to obtain the second business data processing result.

[0097] This invention addresses business scenarios where there is some tolerance for the timeliness of batch processing of business data. It solves the problems of incomplete data supply and inconsistent time periods from upstream components / systems by delaying data batch processing, thereby improving the integrity and accuracy of business data, ensuring consistency of business data in terms of time periods, saving human resources, and meeting the rigid requirements of some regulators for data segmentation and periodic statistical reporting based on natural dates.

[0098] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0099] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0100] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0101] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0102] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of the present invention. It should be understood that the above descriptions are merely specific embodiments of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A method for processing business data batches, characterized by, The application comprises the following steps: receiving a service data processing request sent by an upstream service system, wherein the service data processing request comprises batch service data to be processed and a data batch date corresponding to the batch service data to be processed, wherein each piece of service data to be processed carries a data identifier representing an actual occurrence date of each piece of service data to be processed; dividing the batch service data to be processed according to the data batch date corresponding to the batch service data to be processed and the actual occurrence date of each piece of service data to be processed, to obtain a first data set and a second data set; wherein the actual occurrence date of the service data in the first data set is different from the data batch date, and the actual occurrence date of the service data in the second data set is the same as the data batch date; merging the first data set with a first temporary data set to obtain a first complete data set, processing the service data in the first complete data set to obtain a first service data processing result, wherein the data batch date of the service data in the first temporary data set is the same as the actual occurrence date of the service data in the first data set; temporarily storing the second data set to obtain a second temporary data set, merging the second temporary data set with a data set having the same actual occurrence date of the service data in the second temporary data set to obtain a second complete data set, and processing the service data in the second complete data set to obtain a second service data processing result.

2. The method of claim 1, wherein, The data batch date is determined according to the supply frequency agreed upon in advance with the upstream service system; and the data occurrence date refers to the natural date when the service data actually occurs.

3. The method of claim 1, wherein, The dividing of the batch service data to be processed according to the data batch date corresponding to the batch service data to be processed and the actual occurrence date of each piece of service data to be processed to obtain a first data set and a second data set comprises the following steps: comparing the data batch date corresponding to the batch service data to be processed with the actual occurrence date of each piece of service data to be processed; dividing the batch service data to be processed according to the comparison result to obtain a first data set and a second data set.

4. The method of claim 3, wherein, The dividing of the batch service data to be processed according to the comparison result to obtain a first data set and a second data set comprises the following steps: when the comparison result is consistent, dividing the corresponding service data to be processed into the first data set; when the comparison result is inconsistent, dividing the corresponding service data to be processed into the second data set.

5. The method of claim 1, wherein, The application further comprises the following steps: sending the first service data processing result and the second service data processing result to a downstream service system or a management system.

6. A service data batch processing apparatus characterized by comprising: The application comprises the following steps: a service data processing request receiving module, configured to receive a service data processing request sent by an upstream service system, wherein the service data processing request comprises batch service data to be processed and a data batch date corresponding to the batch service data to be processed, wherein each piece of service data to be processed carries a data identifier representing an actual occurrence date of each piece of service data to be processed; The business data division module is configured to divide the batch of to-be-processed business data according to the data batch date corresponding to the batch of to-be-processed business data and the actual occurrence date of each to-be-processed business data, to obtain a first data set and a second data set; the actual occurrence date of the business data in the first data set is different from the data batch date, and the actual occurrence date of the business data in the second data set is the same as the data batch date. The first merging and processing module is configured to merge the first data set and a first temporary data set to obtain a first complete data set, and process the business data in the first complete data set to obtain a first business data processing result; the data batch date of the business data in the first temporary data set is the same as the actual occurrence date of the business data in the first data set. The second merging and processing module is configured to temporarily store the second data set to obtain a second temporary data set, to be merged with a data set having the same actual occurrence date of the business data in the second temporary data set, to obtain a second complete data set, and process the business data in the second complete data set to obtain a second business data processing result.

7. The apparatus of claim 6, wherein, The data batch date is determined according to a predetermined supply frequency agreed with an upstream business system; and the data occurrence date refers to the natural date when the business data actually occurs.

8. The apparatus of claim 6, wherein, The business data division module is specifically configured to: compare the data batch date corresponding to the batch of to-be-processed business data with the actual occurrence date of each to-be-processed business data; and divide the batch of to-be-processed business data according to the comparison result, to obtain the first data set and the second data set.

9. The apparatus of claim 8, wherein, The business data division module is specifically configured to: when the comparison result is consistent, divide the corresponding to-be-processed business data into the first data set; and when the comparison result is inconsistent, divide the corresponding to-be-processed business data into the second data set.

10. The apparatus of claim 6, wherein, The sending module is further configured to: send the first business data processing result and the second business data processing result to a downstream business system or a management system.

11. A computer device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, The processor executes the computer program to implement the method of any one of claims 1 to 5.

12. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, and the computer program is executed by the processor to implement the method of any one of claims 1 to 5.

13. A computer program product, characterised in that, The computer program product includes a computer program, and the computer program is executed by the processor to implement the method of any one of claims 1 to 5.

Citation Information

Patent Citations

  • Data processing method and device applied to bank batch processing

    CN105677465A

  • Data batch processing method and device

    CN110263241A