Business data processing method and device, computer device and storage medium

Abstract

The application relates to a service data processing method and device, computer equipment, a storage medium and a computer program product. The method comprises the following steps: obtaining target service information, starting service information corresponding to the target service and reference service information from a message platform; when the target service time is a backward time of the reference service time, updating the reference service information based on the target service information, and writing the target service information into a current check queue and a current service queue to obtain a target check queue and a target service queue; when the target service time is a non-backward time of the reference service time, updating the starting service information based on the target service information, determining to-be-backtracked service information from the current check queue, writing the target service information into the current check queue and the current service queue as forward service information of the to-be-backtracked service information, and obtaining the target check queue and the target service queue. The method can improve the orderliness of service data processing.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, in particular to a business data processing method and device, computer equipment, storage medium and computer program product. BACKGROUND

[0002] With the development of data processing technology, distributed data reading technology appears, which synchronously reads data in multiple storage partitions corresponding to a message platform, and then performs corresponding data processing based on the read data.

[0003] However, when using the traditional technology to synchronously read data from multiple storage partitions in the message platform, it is difficult to ensure that the read data is in order, and the problem of data reading confusion may occur. SUMMARY

[0004] Therefore, it is necessary to provide a business data processing method and device, computer equipment, computer readable storage medium and computer program product capable of improving the order of business data processing.

[0005] The present application provides a business data processing method. The method comprises:

[0006] Synchronously obtaining candidate business information corresponding to a target business from multiple business partitions corresponding to the target business on a message platform, to obtain multiple candidate business information;

[0007] Determining target business information from each candidate business information; the target business information includes target business data and target business time corresponding to the target business data;

[0008] Obtaining starting business information and reference business information corresponding to the target business; the starting business information includes starting business time, and the reference business information includes reference business time;

[0009] When the target business time is a backward time of the reference business time, updating the reference business information based on the target business information, and writing the target business information into the tail of the current check queue and the current business queue respectively to obtain a target check queue and a target business queue;

[0010] When the target business time is a non-backward time of the reference business time, updating the starting business information based on the target business information, determining the to-be-backtracking business information from the current check queue based on the reference business information and the updated starting business information, and writing the target business information into the current check queue and the current business queue as forward business information of the to-be-backtracking business information to obtain the target check queue and the target business queue; the target check queue and the target business queue are used as the current check queue and the current business queue to be written into the next target business information.

[0011] The application further provides a service data processing device. The device comprises:

[0012] A candidate information acquisition module is configured to synchronously acquire candidate service information corresponding to the target service from a plurality of service partitions corresponding to the target service on the message platform, and obtain a plurality of candidate service information.

[0013] A target information determination module is configured to determine target service information from the candidate service information, wherein the target service information comprises target service data and target service time corresponding to the target service data.

[0014] A service information determination module is configured to acquire starting service information corresponding to the target service and reference service information, wherein the starting service information comprises starting service time, and the reference service information comprises reference service time.

[0015] A target queue determination module is configured to, when the target service time is backward time of the reference service time, update the reference service information based on the target service information, write the target service information into the tail of the current check queue and the current service queue respectively, and obtain a target check queue and a target service queue.

[0016] A service information backtracking module is configured to, when the target service time is non-backward time of the reference service time, update the starting service information based on the target service information, determine to-be-backtracked service information from the current check queue based on the reference service information and the updated starting service information, write the target service information into the current check queue and the current service queue as forward service information of the to-be-backtracked service information, and obtain a target check queue and a target service queue; the target check queue and the target service queue are used as the current check queue and the current service queue to be written into by next target service information.

[0017] A computer device comprises a memory and a processor, the memory stores a computer program, and the processor implements the steps of the service data processing method when executing the computer program.

[0018] A computer readable storage medium stores a computer program, and the computer program implements the steps of the service data processing method when executed by a processor.

[0019] A computer program product comprises a computer program, and the computer program implements the steps of the service data processing method when executed by a processor.

[0020] The business data processing method, device, computer device, storage medium and computer program product synchronously obtain candidate business information corresponding to a target business from a plurality of partitions corresponding to a message platform, and determine target business information from each candidate business information, wherein the target business information includes target business data and a target business time. Then, starting business information and reference business information corresponding to the target business are obtained, wherein the starting business information includes a starting business time, and the reference business information includes a reference business time. Before writing the target business information into a current check queue and a current business queue, the target business time and the reference business time are compared. When the target business time is a backward time of the reference business time, the target business information is used to update the reference business information, and the target business information is written into the tail of the current check queue and the current business queue, respectively, to obtain a target check queue and a target business queue. When the target business time is a non-backward time of the reference business time, the target business information is used to update the starting business information, and based on the reference business information and the updated starting business information, to-be-backtracked business information is determined from the current check queue, and the target business information is written into the current check queue and the current business queue as forward business information of the to-be-backtracked business information, to obtain the target check queue and the target business queue. In this way, when the target business time is a non-backward time of the reference business time, the to-be-backtracked business information that needs to be backtracked can be determined from the current check queue based on the reference business information and the updated starting business information, and then the target business information is written into the current check queue and the current target business queue as forward business information of the to-be-backtracked business information, so that the data read in the plurality of business partitions is in order, the order of data processing is improved, in addition, only part of the data needs to be backtracked to realize the sequential reading of the data, the cost of data backtracking is effectively reduced, and the efficiency of business data processing is improved. BRIEF DESCRIPTION OF DRAWINGS

[0021] Figure 1 An application environment diagram of a business data processing method in an embodiment;

[0022] Figure 2 A flowchart of a business data processing method in an embodiment;

[0023] Figure 3 A flowchart of business information backtracking in an embodiment;

[0024] Figure 4 A flowchart of a business data processing method in another embodiment;

[0025] Figure 5 A structural block diagram of a business data processing device in an embodiment;

[0026] Figure 6is a structural block diagram of a service data processing apparatus in another embodiment;

[0027] Figure 7 is an internal structure diagram of a computer device in an embodiment. DETAILED DESCRIPTION

[0028] In order to make the purposes, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and not intended to limit the present application.

[0029] The service data processing method provided by the embodiments of the present application can be applied in an application environment as shown in Figure 1 The terminal 102 communicates with the server 104 through a network. The data storage system can store data required to be processed by the server 104. The data storage system can be integrated on the server 104, or placed on a cloud or other network server. The terminal 102 can be, but is not limited to, various personal computers, notebook computers, smart phones, tablet computers, Internet of Things devices and portable wearable devices. The Internet of Things device can be a smart television, a smart vehicle device, etc. The portable wearable device can be a smart watch, a smart bracelet, a head-mounted device, etc. The server 104 can be implemented by an independent server or a server cluster composed of multiple servers. The terminal 102 and the server 104 can be directly or indirectly connected through wired or wireless communication, which is not limited in the present application.

[0030] The service data processing method provided in the embodiments of the present application can be applied to a server.

[0031] For example, the server synchronously obtains candidate business information corresponding to the target business from a plurality of business partitions corresponding to the target business on the message platform, and obtains a plurality of candidate business information. The server determines target business information from each candidate business information, and the target business information includes target business data and target business time corresponding to the target business data. The server obtains starting business information corresponding to the target business and reference business information, and the starting business information includes starting business time, and the reference business information includes reference business time. When the target business time is a backward time of the reference business time, the server updates the reference business information based on the target business information, writes the target business information into the tail of the current check queue and the current business queue respectively, and obtains a target check queue and a target business queue. When the target business time is a non-backward time of the reference business time, the server updates the starting business information based on the target business information, determines to-be-backtracking business information from the current check queue based on the reference business information and the updated starting business information, writes the target business information into the current check queue and the current business queue as forward business information of the to-be-backtracking business information, and obtains a target check queue and a target business queue. The target check queue and the target business queue are used as the current check queue and the current business queue to be written into the next target business information.

[0032] In one embodiment, as shown in Figure 2 A business data processing method is provided. The business data processing method is described by taking a server as an example. The business data processing method comprises the following steps:

[0033] Step S202, synchronously obtaining candidate business information corresponding to the target business from a plurality of business partitions corresponding to the target business on the message platform, and obtaining a plurality of candidate business information.

[0034] The message platform is a distributed publish-subscribe message queue system, which is used to receive and save data produced by a message producer. The data stored on the message platform can be consumed by a message consumer. The message platform classifies the received data according to topics. Each topic corresponds to one or more storage partitions in the message platform. The storage partition is used to store the data of the topic corresponding to the storage partition. When new data corresponding to the topic is received, the message platform stores the data in one of the storage partitions corresponding to the topic. Since the new data is added to the end of the data sequence in the storage partition, the data in the storage partition is in order. For example, the topics can be manufacturer A, manufacturer B and manufacturer C. In the message platform, manufacturer A corresponds to three storage partitions a, b and c. When the message platform receives business data corresponding to manufacturer A, the business data is written into a storage partition corresponding to manufacturer A.

[0035] The target service refers to a service currently requiring service data processing. The target service has a corresponding topic and at least one storage partition in the message platform. The service partition refers to the corresponding storage partition of the target service in the message platform. For example, the target service can be a service report corresponding to manufacturer A. At this time, the topic corresponding to the target service in the message platform is manufacturer A, and the storage partitions corresponding to the target service in the message platform are a, b and c. The storage partitions a, b and c are the respective service partitions corresponding to the target service in the message platform.

[0036] The service information refers to the data information stored in the message platform. The service information includes service data and service time. The service data refers to the information subject of the service information, and the service time refers to the time attribute corresponding to the service data. For example, when the target service is a bill report corresponding to manufacturer A, the respective service information corresponding to the target service in the message platform is the respective bill information corresponding to manufacturer A. At this time, the service data is the bill, and the service time is the bill date corresponding to the bill.

[0037] The candidate service information refers to the service information corresponding to the target service currently synchronized from the message platform.

[0038] For example, the target service has multiple service partitions in the message platform, and each service partition stores the service information corresponding to the target service. In order to improve the efficiency of service information acquisition and ensure the efficiency of service data processing, the server synchronizes the candidate service information corresponding to the target service from the multiple service partitions corresponding to the target service in the message platform, and obtains the candidate service information respectively acquired from each service partition.

[0039] In step S204, the target service information is determined from each candidate service information. The target service information includes target service data and target service time corresponding to the target service data.

[0040] The target service information refers to the candidate service information determined from each candidate service information and written into the current check queue and the current service queue. The target service data refers to the service data corresponding to the target service information. The target service time refers to the service time corresponding to the target service information.

[0041] For example, the server takes any one of the candidate service information as the target service information, and then writes the target service information into the current check queue and the current service queue based on the target service time corresponding to the target service information and the reference service information and the starting service information corresponding to the target service, to obtain the target check queue and the target service queue.

[0042] In step S206, the starting service information and the reference service information corresponding to the target service are obtained; the starting service information includes a starting service time, and the reference service information includes a reference service time.

[0043] The starting service information refers to the service information that causes the service information to be traced back the last time in the current time period. For example, if the service information in the current verification queue is A-B-F-C-D-E, the corresponding service times are January 1, January 2, January 3, January 4, January 5 and January 6, and the service information that causes the service to be traced back the last time is F, it is indicated that the starting service information at this time is F.

[0044] The reference service information refers to the service information with the latest service time in the current verification queue and the current service queue. For example, if the service information in the current verification queue and the service information in the current service queue are both A-B-F-C-D-E, the corresponding service times are January 1, January 2, January 3, January 4, January 5 and January 6, and the reference service information at this time is E.

[0045] The starting service time refers to the service time corresponding to the starting service information. The reference service time refers to the service time corresponding to the reference service information.

[0046] Exemplarily, the server obtains the starting service information and the reference service information corresponding to the target service, the starting service information is the service information that causes the service information to be traced back the last time, and the reference service information is the service information with the latest service time in the current verification queue and the current service queue.

[0047] In step S208, when the target service time is a backward time of the reference service time, the reference service information is updated based on the target service information, the target service information is written into the tail of the current verification queue and the current service queue respectively, and the target verification queue and the target service queue are obtained.

[0048] The backward time refers to a later time. For example, January 2, 2022 is a backward time of January 1, 2022.

[0049] The verification queue refers to a queue composed of each service information corresponding to the target service read from the message platform, stored in a distributed, column-oriented open source database, and each service information in the verification queue is in order and used to determine the to-be-traced-back service information.

[0050] The business queue refers to a queue composed of each business information corresponding to the target business read from the message platform, and is used to implement the target business. For example, when the target business is to generate a bill report corresponding to manufacturer A, the business queue is a bill queue composed of each bill information corresponding to manufacturer A, and the business queue used to implement the target business refers to that the bill report corresponding to manufacturer A is generated by performing corresponding data processing on each bill information in the business queue.

[0051] The current check queue refers to the check queue of the current time period when the target business information has not been written into the check queue.

[0052] The current business queue refers to the business queue of the current time period when the target business information has not been written into the business queue.

[0053] The target check queue refers to the check queue obtained after the target business information is added to the current check queue. If the business information needs to be traced back during the adding process, the target business information is written into the current check queue as the forward business information of the to-be-traced-back business information, and the check queue obtained.

[0054] The target business queue refers to the business queue obtained after the target business information is added to the current business queue. If the business information needs to be traced back during the adding process, the target business information is written into the current business queue as the forward business information of the to-be-traced-back business information, and the business queue obtained.

[0055] Exemplarily, the server compares the target business time corresponding to the target business information and the reference business time corresponding to the target business. When the target business time is the backward time of the reference business time, the reference business information is updated based on the target business information, so that the reference business information is always the business information with the latest business time in the check queue and the business queue. The target business information is written into the tail of the current check queue to obtain the target check queue, and the target business information is written into the tail of the current business queue to obtain the target business queue. When the next target business information is obtained, the target check queue and the target business queue are used as the current check queue and the current business queue to which the next target business information is to be written.

[0056] In step S210, when the target business time is the non-backward time of the reference business time, the starting business information is updated based on the target business information, the to-be-traced-back business information is determined from the current check queue based on the reference business information and the updated starting business information, and the target business information is written into the current check queue and the current business queue as the forward business information of the to-be-traced-back business information, to obtain the target check queue and the target business queue. The target check queue and the target business queue are used as the current check queue and the current business queue to which the next target business information is to be written.

[0057] The non-backward time refers to an earlier time or the same time. For example, January 1, 2022 is a non-backward time of January 2, 2022, and January 1, 2022 is a non-backward time of January 1, 2022.

[0058] The to-be-rewound business information refers to the business information that needs to be rewound before the target business information is written into the current check queue and the current business queue. The forward business information of the to-be-rewound business information refers to the business information located before each to-be-rewound business information in the target check queue or the target business queue. For example, if the business information in the current check queue and the current business queue is A-B-C-D-E, the corresponding business times are January 1, January 2, January 4, January 5, and January 6, respectively, and the target business information is F, the corresponding business time of F is January 3, at this time, the updated starting business information is F, the reference business information is E, and based on the reference business information and the updated starting business information, the to-be-rewound business information C-D-E is determined from the current check queue. The forward business information of the to-be-rewound business information refers to adding the target business information F before the to-be-rewound business information C-D-E in the current check queue and the current business queue, respectively, to obtain the target check queue and the target business queue, and the business information in the target check queue and the target business queue is A-B-F-C-D-E.

[0059] Exemplarily, the server compares the target business time corresponding to the target business information and the reference business time corresponding to the target business, and when the target business time is a non-backward time of the reference business time, it means that the target business information is not the latest business information in the current check queue and the current business queue in terms of business time, and therefore the target business information cannot be directly written at the tail of the current business queue and the current check queue. At this time, the server updates the starting business information based on the target business information, so that the starting business information is always the business information that causes the latest rewinding of business information in the check queue and the business queue. Based on the reference business time in the reference business information and the starting business time in the updated starting business information, the to-be-rewound business information is screened out in the current check queue, and then the target business information is written before the to-be-rewound business information in the current check queue to obtain the target check queue, and the target business is written before the to-be-rewound business information in the current business queue to obtain the target business queue. When the next target business information is obtained, the target check queue and the target business queue are used as the current check queue and the current business queue to which the next target business information is to be written.

[0060] In one embodiment, when the target business time is a backward time of the reference business time, the target business information is written to the tail of the current business queue to obtain a target business queue, and the target business information is consumed from the tail of the target business queue, i.e., the target business information is read and corresponding data processing is performed to obtain an intermediate business result corresponding to the target business information. The intermediate business result corresponding to the target business information refers to that the business information is read in sequence from the target business queue and corresponding data processing is performed until the target business information is read, and a data processing result is obtained after corresponding data processing is performed based on the target business data. For example, when the target business is a bill report corresponding to a manufacturer A, three business information, i.e., bill A-bill B-bill C, are stored in the target business queue in sequence, the processing result obtained by reading the bill A and performing data processing on the bill A is the intermediate business result corresponding to the bill A, and the intermediate business result at this time is the bill report corresponding to the manufacturer A based on the bill A. The bill A, the bill B and the bill C are read in sequence and corresponding data processing is performed to obtain a processing result, which is the intermediate business result corresponding to the bill C, and the intermediate business result at this time is the bill report corresponding to the manufacturer A based on the bill A, the bill B and the bill C. When the target business time is a non-backward time of the reference business time, the target business queue is obtained by backtracking the current business queue, and the forward business information corresponding to the target business information is determined in the target business queue. For example, when four business information, i.e., A-B-C-D, are stored in the target business queue in sequence, and D is the target business information, the forward business information corresponding to D is C. The intermediate business result corresponding to the forward business information is obtained, and based on the intermediate business result corresponding to the forward business information, the business information is consumed from the target business information in the target business queue until the target business information and each backtracking business information are consumed to obtain an intermediate business result corresponding to the target business queue, i.e., an intermediate business result corresponding to the business information at the tail of the target business queue. In this way, each business information is consumed in sequence according to the order of the business information in the target business queue, and the order of the business information consumption process is ensured.

[0061] In the business data processing method, the candidate business information corresponding to the target business is synchronously obtained from the multiple partitions corresponding to the message platform, and the target business information is determined from each candidate business information, the target business information including target business data and target business time. Then, the starting business information corresponding to the target business and the reference business information are obtained, the starting business information including starting business time, and the reference business information including reference business time. Before writing the target business information into the current check queue and the current business queue, the target business time and the reference business time are compared. When the target business time is the backward time of the reference business time, the target business information is used to update the reference business information, and the target business information is written into the tail of the current check queue and the current business queue respectively, to obtain the target check queue and the target business queue. When the target business time is the non-backward time of the reference business time, the target business information is used to update the starting business information, and based on the reference business information and the updated starting business information, the to-be-backtracked business information is determined from the current check queue, the target business information is written into the current check queue and the current business queue as the forward business information of the to-be-backtracked business information respectively, to obtain the target check queue and the target business queue. In this way, when the target business time is the non-backward time of the reference business time, the to-be-backtracked business information that needs to be backtracked can be determined from the current check queue based on the reference business information and the updated starting business information, and then the target business information is written into the current check queue and the current target business queue respectively as the forward business information of the to-be-backtracked business information, so that the data read from the multiple business partitions is in order, the order of data processing is improved, in addition, only part of the data needs to be backtracked to realize the sequential reading of the data, the cost of data backtracking is effectively reduced, and the efficiency of business data processing is improved.

[0062] In one embodiment, as shown in Figure 3 based on the reference business information and the updated starting business information, the to-be-backtracked business information is determined from the current check queue, the target business information is written into the current check queue and the current business queue as the forward business information of the to-be-backtracked business information respectively, to obtain the target check queue and the target business queue, including:

[0063] In step S302, based on the reference business time and the target business time, the to-be-backtracked business information is determined from the current check queue.

[0064] In step S304, the to-be-backtracked business information is removed from the current check queue and the current business queue, to obtain the initial check queue and the initial business queue.

[0065] In step S306, the target business information is written into the initial check queue and the initial business queue respectively, to obtain the intermediate check queue and the intermediate business queue.

[0066] In step S308, each to-be-backtracking service information is written into the intermediate check queue and the intermediate service queue, to obtain the target check queue and the target service queue.

[0067] Exemplarily, whether to perform service information backtracking is determined based on the target service time corresponding to the target service information and the reference service time corresponding to the target service. When the target service time is a non-backward time of the reference service time, it is indicated that the target service information cannot be directly written into the tail of the current check queue and the current service queue. Directly writing into the tail cannot guarantee the order of reading the service data. Therefore, the server filters each service information with the service time between the reference service time and the target service time from the current check queue as to-be-backtracking service information based on the reference service time corresponding to the target service and the target service time corresponding to the target service information, and then removes each to-be-backtracking service information from the current check queue to obtain an initial check queue, and removes each to-be-backtracking service information from the current service queue to obtain an initial service queue. Then, the target service information is written into the tail of the initial check queue and the initial service queue respectively to obtain an intermediate check queue and an intermediate service queue. Finally, each to-be-backtracking service information is sequentially written into the tail of the intermediate check queue according to the order in the check queue to obtain a target check queue, and each to-be-backtracking service information is sequentially written into the tail of the intermediate service queue according to the order in the check queue to obtain a target service queue.

[0068] In the above embodiment, based on the target service time and the reference service time, the to-be-backtracking service information can be quickly filtered from the current check queue, and the efficiency of service data processing is improved. Then, the target service information is written into the current check queue and the current service queue as the forward service information of the to-be-backtracking service information to obtain the target check queue and the target service queue. This can avoid backtracking a large amount of service information, reduce the service data backtracking cost, and ensure that the service information in the queue is in order.

[0069] In one embodiment, the target service information further includes a target data site, and the start service information further includes a start data site. When the target service time is a non-backward time of the reference service time, the service data processing method further includes:

[0070] updating the starting business information based on the target business information; determining each to-be-traced business information in the message platform based on the target data site and the starting data site; determining a writing order corresponding to each to-be-traced business information based on an information business time corresponding to each to-be-traced business information; removing each to-be-traced business information from the current check queue and the current business queue to obtain an initial check queue and an initial business queue; and writing the target business information and each to-be-traced business information into the initial check queue and the initial business queue in sequence based on a writing order corresponding to the target business information and each to-be-traced business information to obtain a target check queue and a target business queue; wherein the writing order corresponding to the target business information is before the writing order corresponding to the to-be-traced business data.

[0071] The data site refers to a consumption site corresponding to the business information in the message platform. The target data site refers to a consumption site corresponding to the target business information in the message platform, and is used to indicate a data reading position corresponding to the target business in each business partition of the message platform.

[0072] For example, when the storage partitions corresponding to the target business in the message platform are a and b, five business information A-B-C-D-E are sequentially stored in the storage partition a, and five business information F-G-H-I-J are sequentially stored in the storage partition b, the data site is first set as 0, 0. When the business information A is read from the storage partition a, and the business information A is taken as the target business information, since the business information A is the first business information in the storage partition a, the data site corresponding to the business information A is 1, 0. When the business information A and the business information B are read from the storage partition a, and the business information F and the business information G are read from the storage partition b, the business information C is read from the business partition a as the target business information, and the data site corresponding to the business information C is 3, 2.

[0073] The starting data site refers to a data site corresponding to the starting business information.

[0074] The information business time refers to a business time corresponding to the to-be-traced business information.

[0075] The writing order refers to an order in which the business information is written into the check queue or the business queue. For example, if the to-be-traced business information is C-D, the corresponding business time is January 4 and January 5 respectively, and the target business information is F, the business time corresponding to F is January 3, at this time, the writing order corresponding to the target business information F, the to-be-traced business information C and the to-be-traced business information D is 1, 2 and 3 respectively, that is, the target business information F is written into the initial check queue and the initial business queue first, the target business information C is written into the initial check queue and the initial business queue second, and the target business information D is written into the initial check queue and the initial business queue third.

[0076] Exemplarily, when the target service time is a non-backward time of the reference service time, it is illustrated that the target service information is not the latest service information in the current check queue and the current service queue at this time, and the target service information cannot be directly written at the tail of the current check queue and the current service queue, and service information backtracking is required. It can be seen that the service information that causes the service information backtracking for the last time at this time is the target service information, and therefore, the server updates the starting service information based on the target service information.

[0077] Further, the server determines, based on a target data site corresponding to the target service information and a starting data site corresponding to the starting service information, each service information between the starting data site and the target data site in each service partition corresponding to the target service as to-be-backtracked service information. Based on an information service time corresponding to each to-be-backtracked service information, each to-be-backtracked service information is sorted in chronological order to obtain a write order corresponding to each to-be-backtracked service information. The to-be-backtracked service information is re-written into the check queue and the service queue based on the write order, which can ensure the orderliness of the service information.

[0078] Then, the server removes each to-be-backtracked service information from the current check queue to obtain an initial check queue, and removes each to-be-backtracked service information from the current service queue to obtain an initial service queue. The target service information is written at the tail of the initial check queue to obtain an intermediate check queue, and each to-be-backtracked service information is sequentially written into the intermediate check queue according to the write order corresponding to each to-be-backtracked service information to obtain a target check queue. The target service information is written at the tail of the initial service queue to obtain an intermediate service queue, and each to-be-backtracked service information is sequentially written into the intermediate service queue according to the write order corresponding to each to-be-backtracked service information to obtain a target service queue.

[0079] In the above embodiment, based on the target data site and the starting data site, each to-be-backtracked service information can be quickly determined in the message platform, avoiding a large amount of service information backtracking in the process of realizing sequential reading, and improving the service data processing efficiency. Further, based on the service time corresponding to each to-be-backtracked service information, the write order corresponding to each to-be-backtracked service information is determined. Based on the write order corresponding to the target service information and the to-be-backtracked service information, the target service information and each to-be-backtracked service information are sequentially written into the initial check queue, which can ensure the sequential reading of the service information.

[0080] In one embodiment, the service data processing method further comprises:

[0081] The to-be-traced business information is counted to obtain an expected trace data amount; a maximum value of the bit point and a minimum value of the bit point are determined in the information data bit point corresponding to the to-be-traced business information; the expected trace data amount is calculated based on the maximum value of the bit point and the minimum value of the bit point; when the actual trace data amount and the expected trace data amount are different, each historical read business data corresponding to the target business is reacquired from the message platform; and the data amount corresponding to the historical read business data is equal to the expected trace data amount.

[0082] The actual trace data amount refers to the number of to-be-traced business information actually written into the verification queue and the business queue.

[0083] The information data bit point refers to a data bit point corresponding to the to-be-traced business information.

[0084] The maximum value of the bit point refers to a maximum value in the data bit point corresponding to each to-be-traced business information. The minimum value of the bit point refers to a minimum value in the data bit point corresponding to each to-be-traced business information.

[0085] The expected trace data amount refers to the number of business information expected to be traced based on the maximum value of the bit point and the minimum value of the bit point.

[0086] The historical read business data refers to business information originally planned to be read from the message platform in the current business data processing process. For example, when the target business is a bill report of manufacturer A in February, the historical read business data is bill information with a bill date of February stored in each business partition corresponding to the target business in the current business data processing process.

[0087] Exemplarily, when the target business time is a non-later time of the reference business time, the server determines to-be-traced business information, removes the to-be-traced business information from the current verification queue to obtain an initial verification queue, and writes the target business information into the tail of the initial verification queue to obtain an intermediate verification queue. Then, each to-be-traced business information is sequentially written into the intermediate verification queue to obtain a target verification queue. In the process of sequentially writing each to-be-traced business information into the intermediate verification queue, the number of to-be-traced business information written into the intermediate verification queue is counted until the writing of the to-be-traced business information is completed, and an actual trace data amount is obtained. Meanwhile, based on the information data bit point corresponding to each to-be-traced business information, a maximum value of the bit point and a minimum value of the bit point are determined. Based on the difference between the maximum value of the bit point and the minimum value of the bit point, an expected trace data amount is obtained. When the actual trace data amount and the expected trace data amount are different, it is indicated that the business information tracing is abnormal, and each historical read business data corresponding to the target business is reacquired from the multiple business partitions corresponding to the target business on the message platform.

[0088] In the above embodiment, the expected data amount of rollback is determined based on the information data site corresponding to each piece of to-be-rolled-back business information, and then the actual data amount of rollback is compared with the expected data amount of rollback to determine whether an exception occurs in the process of rolling back the business information. When an exception occurs, each piece of historical read business data corresponding to the target business is reacquired, which can ensure the accuracy and reliability of reading the business information.

[0089] In one embodiment, the target business information is written into the current check queue to obtain a target check queue, including:

[0090] Based on the target business information, a target information identifier corresponding to the target business information is generated. Based on the target information identifier and a check information identifier corresponding to each piece of check business information in the current check queue, the target business information and each piece of check business information are sorted to obtain the target check queue. The sorting of the information identifiers matches the sorting of the business times.

[0091] The information identifier refers to an identifier corresponding to the business information, which is generated based on attribute information of the business data in the business information. The attribute information of the business data includes at least one of the business time, the business identifier, the user identifier, and the creation time of the business data. For example, when the business information is a document information, the attribute information of the document includes the document time, the creation time, the document ID, and the creator ID, etc. The numerical value of the information identifier corresponding to the business information is positively correlated with the business time corresponding to the business information. For example, the business times corresponding to business information A, business information B, and business information C are January 2, January 3, and January 4, respectively, and the numerical value of the information identifiers a, b, and c corresponding to business information A, business information B, and business information C, respectively, is in the order of a < b < c. Since the information identifier is generated based on the attribute information of the business data, such as the business time and the business identifier, and the business identifier corresponding to the business information is unique, the information identifier corresponding to the business information is unique, and the queue obtained by sorting each piece of business information based on the information identifier is also unique.

[0092] The target information identifier refers to an information identifier corresponding to the target business information. The check business information refers to each piece of business information in the current check queue. The check information identifier refers to an information identifier corresponding to the check business information.

[0093] For example, the server generates a target information identifier corresponding to the target business information based on the attribute information of the target business data included in the target business information. The target business information and each piece of check business information in the current check queue are sorted according to the numerical value of the information identifier, and a target check queue is obtained.

[0094] In the above embodiment, the target information identifier is generated based on the service time, service identifier, user identifier and other information contained in the target service data in the target service information, so that the target information identifier corresponding to the target service information is unique, and the uniqueness of the target verification queue obtained through the service data processing is ensured. In addition, since each verification service information in the verification queue is arranged in order, in the service data backtracking process based on the verification queue, it is not necessary to sort each to-be-backtracked service information, and each to-be-backtracked service information is written into the verification queue and the service queue based on the order of each to-be-backtracked service information in the verification queue, so that the efficiency of the service data processing is improved.

[0095] In one embodiment, the service data processing method further comprises:

[0096] obtaining a to-be-written service information set corresponding to the target service; the to-be-written service information set comprises a plurality of to-be-written service information, and each to-be-written service information carries a corresponding service partition identifier; based on the service partition identifier, each to-be-written service information in the to-be-written service information set is written into a corresponding service partition in the message platform, so that the message platform updates the to-be-read service information set and the backup service information set based on the to-be-written service information set, and when the update is successful, the message platform returns a confirmation notification; the confirmation notification is used as a start signal for writing the next to-be-written service information set into the message platform.

[0097] In the above embodiment, the target information identifier is generated based on the service time, service identifier, user identifier and other information contained in the target service data in the target service information, so that the target information identifier corresponding to the target service information is unique, and the uniqueness of the target verification queue obtained through the service data processing is ensured. In addition, since each verification service information in the verification queue is arranged in order, in the service data backtracking process based on the verification queue, it is not necessary to sort each to-be-backtracked service information, and each to-be-backtracked service information is written into the verification queue and the service queue based on the order of each to-be-backtracked service information in the verification queue, so that the efficiency of the service data processing is improved.

[0098] The service partition identifier is used to indicate the corresponding service partition of the to-be-written service information in the message platform. For example, when the target service corresponds to three service partitions, a, b and c, and the to-be-written service information A carries the service partition identifier a, it means that the to-be-written service information A should be written into the service partition a corresponding to the target service.

[0099] The to-be-read service information set refers to a set composed of each service information stored in each service partition corresponding to the target service in the message platform. The backup service information set refers to a backup of the to-be-read service information set in the message platform.

[0100] For example, the server obtains a set of business information to be written corresponding to the target business. Based on the business partition identifier corresponding to the business information to be written, the server writes each piece of business information to be written in the set to be written into the corresponding business partition in the message platform, thus obtaining a set of business information to be read. This allows the message platform to back up business information based on the business information to be written stored in each business partition corresponding to the target business, i.e., writing each piece of business information to be written into the corresponding backup partition in the message platform, thus obtaining a set of backup business information. When the set of business information to be read and the set of backup business information are successfully updated, the message platform returns a confirmation notification. After receiving the confirmation notification, the server continues to obtain the next set of business information to be written.

[0101] In the above embodiments, after each piece of business information to be written is written to the message platform, the message platform updates the backup business information set based on the business information to be written stored in each business partition. After the backup business information set is successfully updated, a confirmation notification is returned to notify the server to continue to obtain the business information set to be written. This can ensure the reliability of business data being written to the message platform, and when an anomaly occurs in the business information set to be written, the backup business information set can be used to ensure the normal operation of business data processing, thus fully ensuring data state consistency.

[0102] In one specific embodiment, the business data processing method of this application can be applied to a document processing system. For example, the document processing system can be a system built on Flink (an open-source stream processing framework).

[0103] Business data processing methods include the following steps:

[0104] 1. Write document information to the message platform

[0105] like Figure 4 As shown, the document processing system obtains the document information to be written for multiple target businesses produced by the production end, and writes each document information to be written to the corresponding business partition in the distributed messaging platform. For example, the distributed messaging platform can be Kafka. Kafka is a high-throughput distributed publish-subscribe messaging system. Using Kafka as a distributed messaging platform can improve the performance of concurrent message writing, and when reading messages, it can consume messages from different partitions, thereby improving message reading capabilities.

[0106] 2. Retrieve current document information

[0107] The document processing system synchronously obtains candidate document information corresponding to the target business from multiple business partitions on the distributed messaging platform, obtains multiple candidate document information, and determines the current document information from each candidate document information.

[0108] 3. Write the bill queue

[0109] The latest bill information and the earliest bill information corresponding to the target service are obtained. The latest bill date maintains the consumption site (i.e., data site) and the bill date (i.e., service time) corresponding to the bill information with the latest bill date in the current service queue in the latest bill date. The earliest bill date maintains the consumption site and the bill date corresponding to the bill information that causes the bill information to be traced back for the last time in the current service queue in the earliest bill date.

[0110] In an embodiment, the format of the latest bill information (i.e., reference service information) and the earliest bill information (i.e., starting service information) can be MapState<id, offset, bill_date>, where id is 0, indicating the earliest bill information, id is 1, indicating the latest bill information, offset is the consumption site corresponding to the bill information, and bill_date is the bill date corresponding to the bill, i.e., <identification, consumption site, bill date>.

[0111] As shown in FIG. 8, when the current bill date of the current bill information is a backward time of the latest bill date of the latest bill information, the latest bill information is updated based on the current bill information, and the current bill information is written into the tail of the current check queue and the current service queue to obtain the target check queue and the target service queue. Figure 4 When the current bill date of the current bill information is a non-backward time of the latest bill date of the latest bill information, the earliest bill information is updated based on the current bill information, and the target check queue and the target bill queue are obtained by determining the bill information to be traced back from the current check queue based on the latest bill information and the updated earliest bill information, and writing the current bill information into the current check queue and the current bill queue as the forward service information of the bill information to be traced back.

[0112]

[0113] ​In the above embodiments, the reading message capability can be improved by synchronously obtaining the candidate bill information corresponding to the target service from the multiple service partitions corresponding to the target service on the distributed message platform. In addition, since the check queue can be stored in HBase (a distributed, column-oriented open source database), the data is arranged in order according to Rowkey (row key) in Hbase, and the data can be checked with the data processed by Flink to fully guarantee the consistency of the data state. Flink is an open source computing framework for distributed data stream processing and batch data processing, which is widely used in the field of data processing, has batch and stream integration, precise state management, event time support, and precise state consistency guarantee, and its state can reach TB level, and still maintains the characteristics of high throughput and low delay. However, the Flink framework does not support sequential reading and writing, and cannot meet the real-time requirements of the business. Therefore, the business data processing method provided by the scheme can realize a sequential reading and writing method based on the Flink framework, so that the Flink framework can read and write data into multiple nodes according to the business requirements, thereby improving the efficiency and real-time performance of the business data processing.

[0114] It should be understood that, although each step in the flowchart involved in each embodiment as described above is displayed in sequence according to the arrow, these steps are not necessarily executed in the order indicated by the arrow. Unless otherwise specified herein, the execution of these steps is not strictly limited in sequence, and these steps can be executed in other orders. Moreover, at least part of the steps in the flowchart involved in each embodiment as described above can include multiple steps or stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily sequential, but can be alternately executed with at least part of other steps or stages or steps or stages in other steps.

[0115] Based on the same inventive concept, the embodiments of the present application also provide a business data processing apparatus for implementing the above-mentioned business data processing method. The implementation scheme for solving the problem provided by the apparatus is similar to the implementation scheme described in the above method, so the specific limitations in one or more business data processing apparatus embodiments provided below can refer to the limitations of the business data processing method described above, which will not be repeated here.

[0116] In one embodiment, as shown in Figure 5 a business data processing apparatus is provided, comprising: a candidate information acquisition module 502, a target information determination module 504, a service information determination module 506, and a target queue determination module 508, wherein:

[0117] The candidate information obtaining module 502 is configured to synchronously obtain candidate service information corresponding to the target service from a plurality of service partitions corresponding to the target service on the message platform, to obtain a plurality of candidate service information.

[0118] The target information determining module 504 is configured to determine target service information from each candidate service information; the target service information includes target service data and target service time corresponding to the target service data.

[0119] The service information determining module 506 is configured to obtain starting service information corresponding to the target service and reference service information; the starting service information includes starting service time, and the reference service information includes reference service time.

[0120] The target queue determining module 508 is configured to, when the target service time is a backward time of the reference service time, update the reference service information based on the target service information, write the target service information into the tail of the current check queue and the current service queue respectively, and obtain a target check queue and a target service queue.

[0121] The target queue determining module 508 is further configured to, when the target service time is a non-backward time of the reference service time, update the starting service information based on the target service information, determine to-be-backtracked service information from the current check queue based on the reference service information and the updated starting service information, write the target service information into the current check queue and the current service queue as forward service information of the to-be-backtracked service information, and obtain the target check queue and the target service queue; the target check queue and the target service queue are used as the current check queue and the current service queue to which the next target service information is to be written.

[0122] The business data processing apparatus synchronously obtains candidate business information corresponding to a target business from a plurality of partitions corresponding to a message platform, and determines target business information from each candidate business information, the target business information including target business data and a target business time. Then, the apparatus obtains starting business information corresponding to the target business and reference business information, the starting business information including a starting business time, and the reference business information including a reference business time. Before writing the target business information into a current check queue and a current business queue, the target business time and the reference business time are compared. When the target business time is a backward time of the reference business time, the reference business information is updated with the target business information, and the target business information is written into the tail of the current check queue and the current business queue respectively, to obtain a target check queue and a target business queue. When the target business time is a non-backward time of the reference business time, the starting business information is updated with the target business information, and based on the reference business information and the updated starting business information, the apparatus determines to-be-backtracked business information from the current check queue, and writes the target business information into the current check queue and the current business queue as forward business information of the to-be-backtracked business information, to obtain the target check queue and the target business queue. In this way, when the target business time is a non-backward time of the reference business time, the to-be-backtracked business information can be determined from the current check queue based on the reference business information and the updated starting business information, and the target business information can be written into the current check queue and the current target business queue as forward business information of the to-be-backtracked business information, so that the data read from the plurality of business partitions is in order, the order of data processing is improved, and in addition, only part of the data needs to be backtracked to realize the sequential reading of the data, thereby effectively reducing the cost of data backtracking and improving the efficiency of business data processing.

[0123] In one embodiment, the target queue determination module 508 is further configured to:

[0124] based on the reference business time and the target business time, determine to-be-backtracked business information in the current check queue; remove the to-be-backtracked business information from the current check queue and the current business queue to obtain an initial check queue and an initial business queue; write the target business information into the initial check queue and the initial business queue respectively to obtain an intermediate check queue and an intermediate business queue; and write each to-be-backtracked business information into the intermediate check queue and the intermediate business queue to obtain the target check queue and the target business queue.

[0125] In one embodiment, the target queue determination module 508 is further configured to:

[0126] Based on the target business information, a target information identifier corresponding to the target business information is generated; based on the target information identifier and the verification information identifiers corresponding to each verification business information in the current verification queue, the target business information and each verification business information are sorted to obtain the target verification queue; wherein, the sorting of information identifiers matches the sorting of business time.

[0127] In one embodiment, such as Figure 6 As shown, the business data processing device also includes:

[0128] The business information backtracking module 602 is used to update the starting business information based on the target business information; determine each piece of business information to be backtracked in the message platform based on the target data position and the starting data position; determine the writing order of each piece of business information to be backtracked based on the information business time corresponding to each piece of business information to be backtracked; remove each piece of business information to be backtracked from the current verification queue and the current business queue to obtain the initial verification queue and the initial business queue; and write the target business information and each piece of business information to be backtracked into the initial verification queue and the initial business queue in sequence based on the writing order corresponding to the target business information and the business data to be backtracked to obtain the target verification queue and the target business queue; the writing order corresponding to the target business information is before the writing order corresponding to the business data to be backtracked.

[0129] The business information verification module 604 is used to statistically analyze the business information to be traced back to obtain the expected amount of traced data; determine the maximum and minimum values ​​of the information data points corresponding to the business information to be traced back; calculate the expected amount of traced data based on the maximum and minimum values ​​of the points; when the expected amount of traced data is different from the expected amount of traced data, re-obtain the historical read business data corresponding to the target business from the message platform; the amount of data corresponding to the historical read business data is equal to the expected amount of traced data.

[0130] The business information writing module 606 is used to obtain the set of business information to be written corresponding to the target business. The set of business information to be written includes multiple sets of business information to be written, each set of business information to be written carrying a corresponding business partition identifier. Based on the business partition identifier, each set of business information to be written in the set of business information to be written is written to the corresponding business partition in the message platform, so that the message platform updates the set of business information to be read and the backup set of business information based on the set of business information to be written. When the update is successful, the message platform returns a confirmation notification. The confirmation notification is used as a start signal for writing the next set of business information to be written to the message platform.

[0131] The various modules in the service data processing apparatus can be implemented wholly or partially by software, hardware, and combinations thereof. The various modules can be embedded in or independent of a processor in a computer device in hardware form, or stored in a memory in a computer device in software form, so as to be invoked and executed by a processor to perform operations corresponding to the various modules.

[0132] In one embodiment, a computer device is provided, which can be a server, and an internal structure diagram of the computer device can be as shown in Figure 7 The computer device includes a processor, a memory, an input / output interface (I / O), and a communication interface. The processor, the memory, and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for running the operating system and the computer program in the non-volatile storage medium. The database of the computer device is configured to store data such as a current verification queue, a current service queue, and target service information. The input / output interface of the computer device is configured to exchange information between the processor and external devices. The communication interface of the computer device is configured to communicate with terminals outside through a network connection. The computer program is executed by the processor to implement a service data processing method.

[0133] Those skilled in the art can understand that Figure 7 The structure shown in the above embodiment is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. A specific computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0134] In one embodiment, a computer device is provided, which includes a memory and a processor, and the memory stores a computer program. The processor executes the computer program to implement the steps in the above method embodiments.

[0135] In one embodiment, a computer readable storage medium is provided, which stores a computer program. The computer program is executed by a processor to implement the steps in the above method embodiments.

[0136] In an embodiment, a computer program product or computer program is provided, which includes computer instructions stored in a computer readable storage medium. A processor of a computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions, so that the computer device performs the steps in each of the above method embodiments.

[0137] It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of related data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0138] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when the computer program is executed, the processes of the above-mentioned embodiments of the methods can be included. Any reference to memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory, optical storage, high-density embedded non-volatile memory, resistive memory (ReRAM), magnetoresistive random access memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric memory (Ferroelectric Random Access Memory, FRAM), phase change memory (Phase Change Memory, PCM), graphene memory, etc. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, etc. As an illustration but not limitation, RAM can be in various forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), etc. The database involved in the embodiments provided in the present application can include at least one of a relational database and a non-relational database. The non-relational database can include a distributed database based on a block chain, etc., without being limited thereto. The processor involved in the embodiments provided in the present application can be a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., without being limited thereto.

[0139] Any combination of the technical features of the above embodiments can be made. In order to make the description simple, all possible combinations of the technical features in the above embodiments are not described, however, as long as the combination of the technical features does not exist contradictory, it should be considered as the scope of the present application.

[0140] The above embodiments only express several implementation manners of the present application, and the description is more specific and detailed, but it should not be understood as a limitation on the scope of the patent of the present application. It should be pointed out that for ordinary skilled in the art, without departing from the concept of the present application, a number of modifications and improvements can be made, which are within the scope of protection of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.

Claims

1. A business data processing method, characterized in that, The method includes: Simultaneously obtain candidate business information corresponding to the target business from multiple business partitions corresponding to the target business on the messaging platform to obtain multiple candidate business information; Target service information is determined from each candidate service information; the target service information includes target service data and the target service time corresponding to the target service data; Obtain the starting service information and reference service information corresponding to the target service; the starting service information includes the starting service time, and the reference service information includes the reference service time. When the target service time is the backward time of the reference service time, the reference service information is updated based on the target service information, and the target service information is written to the tail of the current verification queue and the current service queue respectively to obtain the target verification queue and the target service queue. When the target service time is a non-backward time of the reference service time, the starting service information is updated based on the target service information. Based on the reference service information and the updated starting service information, the service information to be traced back is determined from the current verification queue. The target service information is written into the current verification queue and the current service queue respectively as the forward service information of the service information to be traced back, thus obtaining the target verification queue and the target service queue. The target verification queue and the target service queue are used as the current verification queue and the current service queue for the next target service information to be written.

2. The method according to claim 1, characterized in that, The step of determining the service information to be backtracked from the current verification queue based on the reference service information and the updated starting service information, and writing the target service information into the current verification queue and the current service queue respectively as the forward service information of the service information to be backtracked, thereby obtaining the target verification queue and the target service queue, includes: Based on the reference service time and the target service time, determine the service information to be traced back in the current verification queue; Remove the business information to be traced back from the current verification queue and the current business queue to obtain the initial verification queue and the initial business queue; The target service information is written into the initial verification queue and the initial service queue respectively to obtain the intermediate verification queue and the intermediate service queue; Each piece of business information to be traced back is written into the intermediate verification queue and the intermediate business queue to obtain the target verification queue and the target business queue.

3. The method according to claim 1, characterized in that, The target service information further includes a target data location, and the starting service information further includes a starting data location. When the target service time is a non-backward time of the reference service time, the method further includes: Update the initial service information based on the target service information; Based on the target data location and the starting data location, each piece of business information to be traced back is determined in the messaging platform; Based on the information service time corresponding to each piece of business information to be traced back, the writing order corresponding to each piece of business information to be traced back is determined. Remove each piece of business information to be traced back from the current verification queue and the current business queue to obtain the initial verification queue and the initial business queue; Based on the writing order corresponding to the target business information and the business data to be traced back, the target business information and each piece of business data to be traced back are sequentially written into the initial verification queue and the initial business queue to obtain the target verification queue and the target business queue; the writing order corresponding to the target business information is before the writing order corresponding to the business data to be traced back.

4. The method according to claim 1, characterized in that, The method further includes: The data from the backtracking business information is statistically analyzed to obtain the actual backtracking data volume. In the information data locations corresponding to the business information to be traced back, determine the maximum and minimum values ​​of the locations; Calculate the expected amount of backtracking data based on the maximum and minimum values ​​of the sites; When the expected backtracking data volume is different from the expected backtracking data volume, the historical read business data corresponding to the target business is retrieved again from the message platform; the data volume corresponding to the historical read business data is equal to the expected backtracking data volume.

5. The method according to claim 1, characterized in that, The target service information is written into the current verification queue to obtain the target verification queue, which includes: Based on the target business information, a target information identifier corresponding to the target business information is generated; Based on the target information identifier and the verification information identifiers corresponding to each verification service information in the current verification queue, the target service information and each verification service information are sorted to obtain the target verification queue; wherein, the sorting of information identifiers matches the sorting of service time.

6. The method according to claim 1, characterized in that, The method further includes: Obtain the set of business information to be written corresponding to the target business; the set of business information to be written includes multiple business information to be written, and each business information to be written carries a corresponding business partition identifier. Based on the service partition identifier, each piece of service information to be written in the set of service information to be written is written to the corresponding service partition in the message platform, so that the message platform updates the set of service information to be read and the backup set of service information based on the set of service information to be written. When the update is successful, the message platform returns a confirmation notification; the confirmation notification is used as a start signal for writing the next set of service information to be written to the message platform.

7. A business data processing device, characterized in that, The device includes: The candidate information acquisition module is used to synchronously acquire candidate business information corresponding to the target business from multiple business partitions corresponding to the target business on the messaging platform, and obtain multiple candidate business information. The target information determination module is used to determine target service information from various candidate service information; the target service information includes target service data and the target service time corresponding to the target service data. The business information determination module is used to obtain the starting business information and reference business information corresponding to the target business; the starting business information includes the starting business time, and the reference business information includes the reference business time. The target queue determination module is used to update the reference service information based on the target service information when the target service time is the backward time of the reference service time, and write the target service information into the tail of the current verification queue and the current service queue respectively to obtain the target verification queue and the target service queue. The target queue determination module is further configured to, when the target service time is a non-backward time of the reference service time, update the starting service information based on the target service information, determine the service information to be backtracked from the current verification queue based on the reference service information and the updated starting service information, and write the target service information into the current verification queue and the current service queue respectively as the forward service information of the service information to be backtracked, thereby obtaining the target verification queue and the target service queue; the target verification queue and the target service queue are used as the current verification queue and the current service queue to be written to the next target service information.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 6.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 6.

Images