Data processing method and device, equipment, medium and program product

Abstract

The invention provides a data processing method and device, equipment, a medium and a program product, which can be applied to the technical field of computers and the technical field of financial science and technology. The method comprises the steps that in response to detection of a plurality of newly-added bill services, a plurality of to-be-processed fields which are generated in the process of processing the plurality of newly-added bill services and matched with preset field identifiers are transmitted to a message storage engine, and the to-be-processed fields comprise the following sub-fields: an object to which a bill belongs, and a preset field identifier which is generated in the process of processing the plurality of newly-added bill services; each to-be-processed field is stored in a message theme library, corresponding to an object to which a bill included in the to-be-processed field belongs, of the message storage engine; determining target historical sub-data matched with the plurality of message theme libraries from the historical bill data based on bill objects corresponding to the plurality of message theme libraries; and based on the to-be-processed fields stored in the plurality of message theme libraries, performing parallel updating on the target historical sub-data matched with the plurality of message theme libraries to obtain updated bill data.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer technology and the technical field of financial technology, in particular to a data processing method, device, equipment, medium and program product. BACKGROUND

[0002] In the processing flow of bill business, various types of bill data are usually continuously generated, and these data often need to be processed before being converted into target bill data for users to view. In recent years, with the continuous growth of bill business volume, the scale of bill data has also expanded dramatically.

[0003] In the related art, due to the low processing efficiency of bill data, the industry generally adopts the mode of "T-1 day offline processing, T day display", which means that the target bill data that users can query on the current date is usually only the target bill data of the previous day. That is, in the process of implementing the present application, it is found that at least the following technical problems exist in the related art: the processing efficiency of bill data is difficult to improve, and the query demand of users for real-time data cannot be met. SUMMARY

[0004] In view of the above problems, the present application provides a data processing method, device, equipment, medium and program product.

[0005] According to one aspect of the present application, a data processing method is provided, comprising: in response to detecting a plurality of new bill businesses, transmitting a plurality of to-be-processed fields generated in the process of processing the plurality of new bill businesses and matching a preset field identifier to a message storage engine, wherein the to-be-processed field includes the following subfields: bill belonging object, each to-be-processed field is stored in a message topic library of the message storage engine corresponding to the bill belonging object included in the to-be-processed field, and different message topic libraries correspond to different bill belonging objects; determining target historical sub-data matching a plurality of message topic libraries from historical bill data based on the bill belonging objects corresponding to the plurality of message topic libraries, wherein the historical bill data is obtained by processing historical to-be-processed fields generated in the process of processing a plurality of historical new bill businesses in a historical period; and based on the to-be-processed fields stored in the plurality of message topic libraries, performing parallel update on the target historical sub-data matching the plurality of message topic libraries respectively to obtain updated bill data.

[0006] According to an embodiment of the present application, the target historical sub-data includes a ticket statistics field; and the target historical sub-data matched with each of the plurality of message topic libraries is updated in parallel based on the to-be-processed field stored in each of the plurality of message topic libraries to obtain updated ticket data, including: for each message topic library, updating the ticket statistics field included in the target historical sub-data matched with the message topic library based on the to-be-processed field stored in the message topic library to obtain intermediate update sub-data; and adding the to-be-processed field to the intermediate update sub-data to obtain target update sub-data; and obtaining the updated ticket data based on the target update sub-data corresponding to each of the plurality of message topic libraries.

[0007] According to an embodiment of the present application, the to-be-processed field further includes the following sub-fields: a ticket identifier, a ticket attribute, and a ticket state; and the historical ticket field included in the target historical sub-data includes the following historical sub-fields: a historical ticket identifier and a historical ticket attribute; and the updating of the ticket statistics field included in the target historical sub-data matched with each of the plurality of message topic libraries based on the to-be-processed field stored in each of the plurality of message topic libraries to obtain intermediate update sub-data includes: in a case where the ticket identifier included in the to-be-processed field is determined to be inconsistent with the historical ticket identifier, updating the ticket statistics field based on the historical ticket attribute to obtain an intermediate ticket statistics field; and updating the intermediate ticket statistics field based on the ticket attribute and the ticket state included in the to-be-processed field to obtain the intermediate update sub-data.

[0008] According to an embodiment of the present application, the ticket attribute includes a ticket expiration time point; and the intermediate ticket statistics field includes a total number of intermediate tickets expiring within a target time period; and the updating of the intermediate ticket statistics field based on the ticket attribute and the ticket state included in the to-be-processed field to obtain the intermediate update sub-data includes: in a case where the to-be-processed field stored in the message topic library is a plurality of to-be-processed fields, sorting the plurality of to-be-processed fields according to the ticket expiration time point to obtain a plurality of sorted to-be-processed fields; determining a boundary to-be-processed field with an expiration time point being a lower limit time point of the target time period from the plurality of sorted to-be-processed fields; determining at least one candidate to-be-processed field based on the boundary to-be-processed field and a preceding to-be-processed field, wherein the preceding to-be-processed field is a to-be-processed field with an expiration time point earlier than the lower limit time point in the plurality of sorted to-be-processed fields; determining a ticket in an available state generated in a new ticket business processing process based on the ticket state included in the candidate to-be-processed field; and updating the total number of intermediate tickets expiring within the target time period based on the number of tickets in the available state to obtain intermediate ticket data.

[0009] According to an embodiment of the present application, the data processing method further comprises: in response to receiving the query request sent by the target client, determining a query range corresponding to the query interface address included in the query request based on the query interface address; generating the query bill data indicated by the query request based on the query bill field in the update bill data that matches the query range; and returning the query bill data to the target client.

[0010] According to an embodiment of the present application, transmitting the plurality of to-be-processed fields matching the preset field identifier generated in the processing of the plurality of newly-added bill businesses to the message storage engine comprises: for each newly-added bill business, determining a preset field identifier for the newly-added bill business based on the business type of the newly-added bill business; matching the real-time bill data generated in the processing of the newly-added bill business with the preset field identifier to obtain the to-be-processed field; and transmitting the to-be-processed field to the message storage engine.

[0011] According to an embodiment of the present application, the data processing method further comprises: in response to the update bill data being the latest bill data in a first time period, obtaining the to-be-processed fields of a plurality of processed bill businesses processed in the first time period from the bill data system; fusing and processing the to-be-processed fields of the plurality of processed bill businesses with the historical latest bill data obtained in a second time period to obtain verification bill data, wherein the second time period is earlier than the first time period, the historical latest bill data is obtained based on the to-be-processed fields of a plurality of historical processed bill businesses processed in the second time period, the historical time period includes the second time period, and the plurality of historical newly-added bill businesses include the plurality of historical processed bill businesses; verifying the update bill data by using the verification bill data to obtain a verification result; and in a case where the verification result represents that the update bill data fails to pass the verification, correcting the update bill data based on the verification bill data to obtain corrected update bill data.

[0012] Another aspect of the present application provides a data processing apparatus, characterized in that the apparatus comprises: a storage module configured to, in response to detecting a plurality of newly added ticket services, transmit a plurality of to-be-processed fields matching a preset field identifier generated in a process of processing the plurality of newly added ticket services to a message storage engine, wherein the to-be-processed fields comprise the following subfields: a ticket belonging object, each to-be-processed field is stored in a message topic library of the message storage engine corresponding to the ticket belonging object included in the to-be-processed field, and different message topic libraries correspond to different ticket belonging objects; a determination module configured to determine target historical sub-data matching a plurality of message topic libraries from historical ticket data based on the ticket belonging objects corresponding to the plurality of message topic libraries respectively, wherein the historical ticket data is obtained by processing historical to-be-processed fields generated in a process of processing a plurality of historical newly added ticket services in a historical period; and a processing module configured to perform parallel update on the target historical sub-data matching the plurality of message topic libraries respectively based on the to-be-processed fields stored in the plurality of message topic libraries respectively to obtain updated ticket data.

[0013] Another aspect of the present application provides an electronic device, comprising: one or more processors; a memory for storing one or more computer programs, wherein the one or more processors execute the one or more computer programs to implement the steps of the method.

[0014] Another aspect of the present application also provides a computer-readable storage medium having stored thereon a computer program or instructions, wherein the computer program or instructions are executed by a processor to implement the steps of the method.

[0015] Another aspect of the present application also provides a computer program product comprising a computer program or instructions, wherein the computer program or instructions are executed by a processor to implement the steps of the method.

[0016] According to the data processing method of the present application, the acquisition of the to-be-processed field is triggered in time when a new bill business is monitored, and a corresponding preset field identifier is preset for each new bill business to reduce the data acquisition amount, and the to-be-processed fields facing different bill objects are stored in the corresponding message topics of the storage engine, and the target historical sub-data matched with each message topic library in the historical bill data is used to realize parallel processing of bill data when there are multiple message topics. Since the new bill business is monitored in real time, the subsequent processing process is triggered as soon as the new bill business is monitored, thereby reducing the processing waiting time, and when processing, the data acquisition amount is reduced from the source through the preset field identifier, and through the sub-topic storage, based on the correspondence between the message topic library and the target historical sub-data, the processing processes of different bill objects do not interfere with each other, supporting parallel processing, solving the technical problems that the bill data processing efficiency is difficult to improve and cannot meet the user's real-time data query demand, and realizing the technical effects of improving the bill data processing speed and meeting the user's real-time display demand for bill data. BRIEF DESCRIPTION OF DRAWINGS

[0017] The above and other objects, features and advantages of the present application will become more apparent from the following description of embodiments of the present application, taken in conjunction with the accompanying drawings, in which:

[0018] Figure 1 An application scenario diagram of the data processing method, device, equipment, medium and program product according to the embodiments of the present application is schematically shown;

[0019] Figure 2 A flowchart of the data processing method according to the embodiments of the present application is schematically shown;

[0020] Figure 3 A data flow diagram of updating the total number of intermediate bills expired in a target period according to the embodiments of the present application is schematically shown;

[0021] Figure 4 A processing framework diagram of the data processing method according to the embodiments of the present application is schematically shown;

[0022] Figure 5 A structure block diagram of the data processing device according to the embodiments of the present application is schematically shown; and

[0023] Figure 6 A block diagram of an electronic device suitable for implementing the data processing method according to the embodiments of the present application is schematically shown. DETAILED DESCRIPTION

[0024] Hereinafter, embodiments of the present application will be described with reference to the accompanying drawings. It is to be understood, however, that the description is merely exemplary of the present application, and is not intended to limit the scope of the present application. In the following detailed description of the embodiments of the present application, numerous specific details are set forth in order to provide a thorough understanding of the present application. However, it will be apparent to one skilled in the art that the present application can be practiced without these specific details. In other instances, well-known structures and functions have not been described in detail in order to avoid obscuring aspects of the present application.

[0025] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the present application. As used herein, the term "includes" and tautological expressions thereof, such as "including," "includes," "include," "contains," "containing," and so forth, shall not be taken to exclude

[0026] All terms used herein including technical and scientific terms have the same meanings as commonly understood by one of ordinary skill in the art unless otherwise defined herein. It should be noted that the terms used herein are merely specific examples for the described embodiments and should not be limiting, and that the terms should be interpreted in the context of the specification as a whole and not in an idealized or overly formal way.

[0027] In the case where expressions similar to "at least one of A, B, and C, and the like" are used, it is generally to be interpreted that the meaning of the expression is the same as that of "at least one of A or B; at least one of A or C; at least one of B or C; at least one of A, B, and C; and the like."

[0028] It should be noted that the data processing method, device, equipment, medium, and program product of the present application can be used in the field of financial technology, and can also be used in any field other than the field of financial technology, such as the field of computer technology and the field of big data technology. The present application does not limit the application field of the data processing method, device, equipment, medium, and program product.

[0029] In the technical solutions of the present application, the user information (including but not limited to user personal information, user image information, user equipment information such as location information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved are information and data authorized by the user or authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure, and application of related data comply with relevant laws, regulations, and standards, take necessary security measures, do not violate public order and good customs, and provide corresponding operation portals for users to choose authorization or refusal.

[0030] In the scenario of making automated decisions by using personal information, the method, device and system provided by the embodiments of the present application provide corresponding operation entrances for users to select to agree or reject the automated decision result; if the user selects to reject, the expert decision process is entered. The expression "automated decision" refers to the activity of automatically analyzing, evaluating the behavior habits, interests and hobbies or economic, health, credit status of a person by a computer program and making decisions. The expression "expert decision" refers to the activity of making decisions by personnel who are engaged in a certain field of work, have specialized experience, knowledge and skills and reach a certain professional level.

[0031] In the research process, it is found that the current bill business management system of a financial institution usually needs to have more statistical query analysis functions, that is, in the processing flow of bill business, the generated bill data needs to be processed according to multiple statistical indicators, so as to be converted into target bill data that can be viewed by users.

[0032] However, in the bill business management system of the related art, the bill data needs to be processed according to multiple statistical indicators by a business staff or an analyst, but the business staff or the analyst needs to face hundreds of bill business tables on a source application and clarify complex correlation logic, and the data processing efficiency is low; in some technologies, although relatively automated bill data processing means are provided, the bill data is often processed in a time unit of day, which not only has low processing efficiency and high latency, but also users can only query the bill business data of the previous day, which is difficult to meet the user demand.

[0033] Therefore, the embodiments of the present application provide a data processing method, which comprises: in response to detecting a plurality of newly added bill businesses, transmitting a plurality of to-be-processed fields generated in the process of processing the plurality of newly added bill businesses and matching a preset field identifier to a message storage engine, wherein the to-be-processed field comprises the following subfields: a bill belonging object, each to-be-processed field is stored in a message topic library of the message storage engine corresponding to the bill belonging object included in the to-be-processed field, and different message topic libraries correspond to different bill belonging objects; determining target historical sub-data matching a plurality of message topic libraries from historical bill data based on the bill belonging objects corresponding to the plurality of message topic libraries respectively, wherein the historical bill data is obtained by processing historical to-be-processed fields generated in the process of processing a plurality of historical newly added bill businesses in a historical period; and performing parallel update on the target historical sub-data matching the plurality of message topic libraries respectively based on the to-be-processed fields stored in the plurality of message topic libraries respectively, to obtain updated bill data.

[0034] Figure 1 An application scenario diagram of the data processing method, device, equipment, medium and program product according to the embodiments of the present application is schematically shown.

[0035] AsFigure 1 As shown, the application scenario 100 according to this embodiment can include a first terminal device 101, a second terminal device 102, a third terminal device 103, a network 104, and a server 105. The network 104 is a medium for providing a communication link between the first terminal device 101, the second terminal device 102, the third terminal device 103, and the server 105. The network 104 can include various connection types, such as wired, wireless communication links, or fiber optic cables, and the like.

[0036] A user can use the first terminal device 101, the second terminal device 102, the third terminal device 103 to interact with the server 105 through the network 104 to receive or send messages, and the like. Various communication client applications can be installed on the first terminal device 101, the second terminal device 102, the third terminal device 103, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, and the like (only as examples).

[0037] The first terminal device 101, the second terminal device 102, the third terminal device 103 can be various electronic devices with a display screen and supporting web browsing, including but not limited to smartphones, tablet computers, laptop computers, desktop computers, and the like.

[0038] The server 105 can be a server providing various services, such as a background management server supporting a website browsed by a user using the first terminal device 101, the second terminal device 102, the third terminal device 103 (only as an example). The background management server can analyze and process received user requests and the like, and feed back the processing results (such as web pages, information, or data, and the like obtained or generated according to user requests) to the terminal device.

[0039] It should be noted that the data processing method provided by the embodiments of the present application can generally be executed by the server 105. Correspondingly, the data processing apparatus provided by the embodiments of the present application can generally be arranged in the server 105. The data processing method provided by the embodiments of the present application can also be executed by a server or a server cluster different from the server 105 and capable of communicating with the first terminal device 101, the second terminal device 102, the third terminal device 103, and / or the server 105. Correspondingly, the data processing apparatus provided by the embodiments of the present application can also be arranged in a server or a server cluster different from the server 105 and capable of communicating with the first terminal device 101, the second terminal device 102, the third terminal device 103, and / or the server 105.

[0040] It should be understood that, Figure 1The number of the first terminal device, the second terminal device, the third terminal device, the network and the server in the figure is only illustrative. According to the implementation needs, there can be any number of the first terminal device, the second terminal device, the third terminal device, the network and the server.

[0041] The following will be based on Figure 1 The described scenario, by Figures 2-4 The data processing method according to the embodiment of the application is described in detail.

[0042] Figure 2 The flowchart of the data processing method according to the embodiment of the application is illustratively shown.

[0043] As Figure 2 The method includes operations S210-S230.

[0044] In operation S210, in response to detecting a plurality of newly added bill businesses, a plurality of to-be-processed fields generated in the process of processing the plurality of newly added bill businesses and matching a preset field identifier are transmitted to a message storage engine, wherein the to-be-processed fields include the following subfields: bill belonging object, each to-be-processed field is stored in a message topic library of the message storage engine corresponding to the bill belonging object included in the to-be-processed field, and different message topic libraries correspond to different bill belonging objects.

[0045] In operation S220, based on the bill belonging objects corresponding to the plurality of message topic libraries respectively, target historical sub-data matching the plurality of message topic libraries is determined from historical bill data, wherein the historical bill data is obtained by processing historical to-be-processed fields generated in the process of processing a plurality of historical newly added bill businesses in a historical period.

[0046] In operation S230, based on the to-be-processed fields stored in the plurality of message topic libraries respectively, the target historical sub-data matching the plurality of message topic libraries respectively is updated in parallel to obtain updated bill data.

[0047] The newly added bill business can be various processing businesses newly generated in the current period and carried out for the bill. The bill can be a bill of exchange, a bill or a check, etc. The bill business includes processing operations on such bills, such as issuance, acceptance, endorsement, discount, etc.

[0048] The preset field identifier can include a plurality of preset subfield identifiers. The preset field identifier can correspond to the effective field for processing of the business type of the newly added bill business. The plurality of preset subfield identifiers included in the preset field identifier corresponding to different business types are different.

[0049] The bill belonging object is not limited and can be the object related to the bill such as the drawer or the biller. The drawer and the biller can be an individual or an enterprise.

[0050] The message storage engine can include a plurality of message topic libraries, and different message topic libraries are used to store messages corresponding to different ticket belonging objects, that is, the to-be-processed fields including different ticket belonging objects are stored in different message topic libraries.

[0051] The newly added ticket business can be detected in real time by means of burying points in the ticket business processing system, and the acquisition operation of the to-be-processed field is triggered whenever the newly added ticket business is detected, and the to-be-processed field is transmitted to the message storage engine. Thus, the real-time ticket data generated in the process of processing a plurality of newly added ticket businesses can be obtained in real time in the process of processing the ticket business in the ticket business processing system without being transmitted to the database, thereby shortening the data transmission path and improving the transmission timeliness of the to-be-processed field.

[0052] After receiving a plurality of to-be-processed fields, the message storage engine can store the plurality of to-be-processed fields in respective corresponding message topic libraries based on the ticket belonging objects included in the plurality of to-be-processed fields, and each message topic library can be sequentially read and written, that is, the message topic library can store the to-be-processed field in the form of a queue row to avoid data reading omission and the like. Similarly, each message topic library can also be parallel read and written to speed up the processing speed.

[0053] The to-be-processed fields stored in the message storage engine are processed by the computing engine, and the computing engine can construct a plurality of processing tasks corresponding to the plurality of message topic libraries, the processing tasks are used to monitor the message topic library, and when detecting that there is a newly added to-be-processed field in the message topic library, the processing operation of the to-be-processed field and the corresponding target historical sub-data is performed, such as operations S220-S230. The plurality of processing tasks can be executed in parallel, thereby speeding up the processing speed of the plurality of to-be-processed fields.

[0054] The historical period can be any period before the current period. The historical ticket data can include historical sub-data of a plurality of ticket belonging objects. The data format of the historical ticket data is not limited, such as a table format, and the historical ticket data can be a data wide table storing relevant ticket data of all ticket belonging objects in an enterprise. The relevant ticket data of each ticket belonging object, that is, the historical sub-data, is stored in the corresponding table row. Thus, the plurality of processing tasks can be processed in parallel without interference. Similarly, the data format of the historical ticket data can also be any format capable of partitioning and storing historical sub-data.

[0055] The target historical sub-data can be historical sub-data corresponding to the ticket belonging object included in the to-be-processed field.

[0056] The target historical sub-data can include historical bill fields of historical bills related to the object to which the bill belongs, and bill statistical fields of the historical bills related to the object to which the bill belongs. The historical bill information can include sub-fields such as historical bill basic information, historical bill attributes, and historical bill states. The historical bill basic information can include historical bill identification, historical bill object, and historical bill date of issue. The historical bill attributes can include historical bill expiration time points and historical bill resource values. The historical bill states can include valid states, invalid states, or frozen states.

[0057] The bill statistical fields can be used to represent statistical information of the historical bills related to the object to which the bill belongs, and can include sub-fields such as total number of historical bills expiring within a target period, total number of historical bills within a resource value interval, and total number of historical bills corresponding to different acceptors, and the like. For example, total number of bills expiring within a month, total number of bills expiring within 7 days, total number of overdue bills, total number of bills with resource values within a target range, total number of bank acceptance bills, and the like.

[0058] According to the data processing method of the present application, the acquisition of the to-be-processed field is triggered immediately when a new bill business is monitored, and a corresponding preset field identifier is preset for each new bill business to reduce the amount of data acquisition. The to-be-processed fields facing different bill objects are stored in the corresponding message topics of the storage engine. By using the target historical sub-data in the historical bill data that matches each message topic library, parallel processing of bill data is realized when there are multiple message topics. Since real-time monitoring of new bill businesses is adopted, the subsequent processing process is triggered when a new bill business is monitored, thereby reducing the processing waiting time. When processing, the amount of data acquisition is reduced from the source by using the preset field identifier, and the processing of different bill objects does not interfere with each other based on the correspondence between the message topic library and the target historical sub-data, supporting parallel processing. The technical problems of difficult improvement of bill data processing efficiency and inability to meet the user's real-time data query demand are solved, and the technical effects of improving bill data processing speed and meeting the user's real-time bill data display demand are realized.

[0059] According to an embodiment of the present application, transmitting the to-be-processed fields generated in the processing of multiple new bill businesses and matching the preset field identifiers to the message storage engine can include the following operations.

[0060] For each new bill business, a preset field identifier for the new bill business is determined based on the business type of the new bill business. Real-time bill data generated in the processing of the new bill business is matched with the preset field identifier to obtain a to-be-processed field. The to-be-processed field is transmitted to the message storage engine.

[0061] Real-time bill data is generated in each new bill business processing process, wherein the real-time bill data can include a to-be-processed field and other fields in addition to the to-be-processed field.

[0062] According to an embodiment of the present disclosure, by triggering the to-be-processed field acquisition operation when detecting the new bill business, and determining the preset field identifier corresponding to the business type of the new bill business based on the to-be-processed field when the to-be-processed field is acquired, the effective field can be filtered from a large amount of real-time bill data through the preset field identifier, and the effective field is transmitted to the message storage engine, so that compared with the related art in which the data is first stored in the database, and after the log analysis, the relevant data processing is performed on the parsed data, the data transmission path can be effectively shortened, the transmission data amount and system input / output resource consumption are reduced, and the storage pressure of the message storage engine is relieved to a certain extent.

[0063] According to an embodiment of the present disclosure, the target historical sub-data includes a bill statistical field; based on the to-be-processed fields stored in each of the plurality of message topic libraries, the target historical sub-data matched with each of the plurality of message topic libraries is updated in parallel to obtain updated bill data, which can include the following operations.

[0064] For each message topic library, based on the to-be-processed field stored in the message topic library, the bill statistical field included in the target historical sub-data matched with the message topic library is updated to obtain intermediate updated sub-data; the to-be-processed field is added to the intermediate updated sub-data to obtain target updated sub-data; and based on the target updated sub-data corresponding to each of the plurality of message topic libraries, the updated bill data is obtained.

[0065] Since the target historical sub-data includes full-amount bill data corresponding to the object to which the bill belongs, after the new bill business processing, the to-be-processed field determined from the newly obtained real-time bill data needs to be added to the target historical sub-data.

[0066] And since the bill statistical field is used to represent the full-amount bill statistical information of the object to which the bill belongs, the to-be-processed field including the effective field can quickly update the bill statistical field.

[0067] The to-be-processed field can be stored in the corresponding historical sub-data through the processing task corresponding to the message topic library, and the bill statistical field is updated based on the to-be-processed field to obtain the updated bill data.

[0068] According to the embodiment of the present application, the effective information of the bill related to the new bill business can be recorded quickly, and the updating speed of the bill statistical field can be accelerated, so as to accelerate the bill data processing speed, and guarantee the real-time display requirement of the user for the bill data.

[0069] According to the embodiment of the present application, the to-be-processed field further includes the following subfields: bill identification, bill attribute and bill state; the historical bill field included in the target historical sub-data includes the following historical subfields: historical bill identification and historical bill attribute; based on the message theme library, the bill statistical field included in the target historical sub-data matched with the message theme library is updated to obtain intermediate update sub-data, which can include the following operations.

[0070] In the case that the bill identification included in the to-be-processed field is inconsistent with the historical bill identification, the bill statistical field is updated based on the historical bill attribute to obtain intermediate bill statistical field; the intermediate bill statistical field is updated based on the bill attribute and the bill state included in the to-be-processed field to obtain intermediate update sub-data.

[0071] The bill attribute can include bill expiration time point and bill resource value, etc. The bill state can include valid state, invalid state or frozen state, etc.

[0072] It can be checked whether there is a historical bill identification consistent with the bill identification. If there is, the historical bill attribute, the historical bill identification and other related subfields corresponding to the historical bill identification are updated by using the to-be-processed field, and the bill statistical field is updated based on the updated related subfields.

[0073] If it is determined that there is no historical bill identification consistent with the bill identification, i.e. the bill identification is inconsistent with the historical bill identification, the bill statistical field can be first updated based on the historical bill attribute, such as: for the initial bill total number included in the bill statistical field which expires within the target period, whether there is a new historical bill in the target period can be determined based on the historical bill expiration time point in the historical bill attribute, so as to update the bill statistical field. Since the current time point is constantly changing, the target period is also constantly changing.

[0074] In the updating of the intermediate bill statistical field based on the bill attribute and the bill state included in the to-be-processed field, the intermediate bill statistical field can be updated based on the bill attribute in combination with the bill state. In the updating, the bill state needs to be considered. If the bill state is in a state other than the valid state, the bill is not counted. For example, for the total number of intermediate bills that expire within a target period included in the intermediate bill statistical field, the number of bills whose expiration time points are within the target period and whose bill states are valid states can be counted, and the total number of intermediate bills is updated. For the total number of intermediate bills whose resource values are in a target range included in the intermediate bill statistical field, the bill resource values included in the bill attribute can be identified, the number of bills whose bill resource values are in the target range and whose bill states are valid states can be determined, and the total number of intermediate bills whose resource values are in the target range is updated.

[0075] After the updating of the intermediate bill statistical field, the target bill statistical field can be obtained. The target bill statistical field is used to replace the bill statistical field in the target historical sub-data, and the target updated sub-data is obtained.

[0076] According to the embodiments of the present application, by checking whether the bill identifier is repeated, the newly added bill and the historical bill can be effectively distinguished, and repeated counting can be avoided. In combination with the historical bill attribute, the bill attribute of the newly added bill, and the bill state of the newly added bill, the statistical field is further updated, so that the accuracy and timeliness of the intermediate updated sub-data are ensured.

[0077] According to the embodiments of the present application, the bill attribute includes a bill expiration time point; the intermediate bill statistical field includes a total number of intermediate bills that expire within a target period; and the updating of the intermediate bill statistical field based on the bill attribute and the bill state included in the to-be-processed field to obtain the intermediate updated sub-data can include the following operations.

[0078] In the case where the to-be-processed fields stored in the message subject library are multiple, the multiple to-be-processed fields are sorted according to the bill expiration time points to obtain the sorted multiple to-be-processed fields; a boundary to-be-processed field whose expiration time point is a lower limit time point of the target period is determined from the sorted multiple to-be-processed fields; at least one candidate to-be-processed field is determined based on the boundary to-be-processed field and a preceding to-be-processed field, wherein the preceding to-be-processed field is a to-be-processed field whose expiration time point is earlier than the lower limit time point in the sorted multiple to-be-processed fields; a bill in a usable state generated in the newly added bill business processing process is determined based on the bill state included in the candidate to-be-processed field; and the total number of intermediate bills that expire within the target period is updated based on the number of bills in the usable state, and the intermediate bill data is obtained.

[0079] The target time period can be updated based on the current time point. For example, when the total number of intermediate bills expiring in the target time period is the total number of bills expiring in the past 7 days, the current time point is added to 7 days to obtain the target time period.

[0080] Figure 3 A data flow diagram of the data processing method according to an embodiment of the present application is schematically shown.

[0081] As shown in Figure 3 When a plurality of to-be-processed fields 301 can be stored in a message topic library, the bill expiration time points 302 included in the plurality of to-be-processed fields 301 can be obtained respectively. The plurality of to-be-processed fields 301 can be sorted according to the bill expiration time points to obtain a plurality of sorted to-be-processed fields 303.

[0082] Based on the bill expiration time points 302 included in the plurality of to-be-processed fields 301, a boundary to-be-processed field 304 with an expiration time point as a lower limit time point of the target time period can be determined from the plurality of sorted to-be-processed fields 303. Based on the arrangement mode, a preceding to-be-processed field with an expiration time point earlier than the lower limit time point can be determined from the plurality of sorted to-be-processed fields 303, so that the candidate to-be-processed field can be quickly determined.

[0083] For example, when the arrangement mode of the plurality of sorted to-be-processed fields 303 is from small to large based on the bill expiration time points, the boundary to-be-processed field 304 and the preceding to-be-processed field before the boundary to-be-processed field 304 in the plurality of sorted to-be-processed fields 303 can be taken as at least one candidate to-be-processed field 305.

[0084] The bill state included in at least one candidate to-be-processed field 305 can be obtained, and based on the bill state, a target candidate to-be-processed field including a bill state in an available state can be determined from at least one candidate to-be-processed field.

[0085] Since one new bill business corresponds to one to-be-processed field, each to-be-processed field can correspond to one bill. Therefore, the number of target candidate to-be-processed fields can be the number of bills 307 in an available state. Based on the number of bills 307 in an available state, the total number of intermediate bills expiring in the target time period can be updated to obtain intermediate bill data 308.

[0086] According to the embodiments of the present application, by sorting according to the expiration time points, the bill range in the target period of time is divided according to the expiration time points of the bills, and the candidate data to be processed is quickly located based on the boundary to-be-processed field and the preceding to-be-processed field, in addition, the available bills are screened in combination with the bill state, so that it can be ensured that the statistical result contains valid data. Therefore, the speed and accuracy of the statistical field update are improved, that is, the processing speed of the bill data is further improved, and the real-time viewing demand of the user for the bill data is ensured.

[0087] According to the embodiments of the present application, the data processing method can further include the following operations.

[0088] In response to receiving the query request sent by the target client, the query range corresponding to the query interface address included in the query request is determined based on the query interface address; the query bill field matching the query range in the updated bill data is determined based on the query bill field, and the query bill data indicated by the query request is generated; and the query bill data is returned to the target client.

[0089] The target client can be a client of a user, and the query bill data can be displayed to the user through the target client.

[0090] Different query interface addresses can correspond to different query ranges, so that by identifying the query interface address included in the query request sent by the target client, the bill field that the target client wants to query can be determined.

[0091] The query bill field can be processed according to the expected format carried in the query request, so as to generate the query bill data indicated by the query request and return it to the target client.

[0092] According to the embodiments of the present application, the query range is determined through the query interface address, and the query data is generated and returned based on the matching field in the query range. The field matching the request in the updated bill data can be quickly located, the transmission of invalid data is reduced, and the query response speed and accuracy are improved.

[0093] According to the embodiments of the present application, the data processing method can further include the following operations.

[0094] In response to the update bill data being the latest bill data in the first period, the to-be-processed fields of the plurality of processed bill services processed in the first period are obtained from the bill data system; the to-be-processed fields of the plurality of processed bill services are fused and processed with the historical latest bill data obtained in the second period to obtain verification bill data, wherein the second period is earlier than the first period, the historical latest bill data is obtained based on the to-be-processed fields of the plurality of historical processed bill services processed in the second period, the historical period includes the second period, and the plurality of historical new bill services include the plurality of historical processed bill services; the update bill data is verified by using the verification bill data to obtain a verification result. In a case where the verification result represents that the update bill data fails to pass the verification, the update bill data is corrected based on the verification bill data to obtain corrected update bill data.

[0095] The first period and the second period are not limited, and can be any preset period. For example, the first period is A day, and the second period is A-1 day, that is, the latest bill data is the final bill data of A day, and the historical latest bill data is the latest bill data of A-1 day.

[0096] Therefore, by processing the to-be-processed fields of all bill services processed on A day with the latest bill data of A-1 day, new update bill data of A day can be obtained.

[0097] The new update bill data of A day can be used as verification bill data, and the update bill data and the verification bill data can be compared to obtain a verification result of the update bill data. That is, if the update bill data is consistent with the verification bill data, it is determined that the verification result of the update bill data passes the verification. Otherwise, if the update bill data is inconsistent with the verification bill data, it is determined that the verification result of the update bill data fails to pass the verification.

[0098] In a case where it is determined that the verification result of the update bill data fails to pass the verification, the fields in the verification bill data can be used to replace the inconsistent fields, so as to correct the update bill data.

[0099] According to the embodiments of the present application, in a case where it is determined that the update bill data is the final bill data of the first period, a time period task can be triggered to obtain full data of the first period and reprocess the full data with the final bill data of the historical period, so as to obtain verification bill data for verifying the update bill data. The verification bill data is used to correct the update bill data in a case where the update bill data fails to pass the verification. Therefore, the reliability of the final data can be ensured, an automatic error correction mechanism of the data is realized, and error accumulation is avoided.

[0100] Figure 4 A processing framework diagram of a data processing method according to another embodiment of the present application is schematically shown.

[0101] As shown in Figure 4 , the point-in-time can be performed in the bill service processing system, so as to acquire the to-be-processed field matching the preset field identifier generated in the process of processing the newly-added bill service in response to detecting the newly-added bill service, that is, the to-be-processed field of the newly-added bill service is acquired through the point-in-time technology. The to-be-processed field of the newly-added bill service is sent to the message storage engine.

[0102] The computing engine can subscribe to or monitor each message topic library of the message storage engine, so as to acquire the to-be-processed field of the newly-added bill service from the corresponding message topic library when there is a newly-added to-be-processed field of the newly-added bill service in any message topic library. The computing engine can acquire historical bill data from the bill database, and perform data processing based on the to-be-processed field and the historical bill data to obtain updated bill data.

[0103] In response to the updated bill data being the latest bill data in a first period, the to-be-processed fields of a plurality of processed bill services processed in the first period can be acquired from the bill data system or the database of the bill data system and input into the data lake for data lake source table or topic aggregation index extraction, so as to obtain verification bill data. The data lake source table can be adding the to-be-processed fields of the plurality of processed bill services to the historical latest bill data obtained in a second period, and the topic aggregation index extraction can be fusion processing of initial target historical sub-data in the historical latest bill data matching the to-be-processed fields of the plurality of processed bill services based on the to-be-processed fields of the plurality of processed bill services, to obtain the verification bill data. At the same time, the verification bill data can be stored in the bill database, and the computing engine can verify the updated bill data based on the verification bill data. If it is determined that the verification result is a verification pass, the updated bill data is stored in the bill database.

[0104] In some embodiments, the target client can acquire query bill data from the updated bill data through a query request carrying a query interface address. If the verification bill data has not been generated, the query bill data can be acquired from the updated bill data obtained based on the to-be-processed field of the newly-added bill service and the historical bill data. If the verification bill data has been generated, the query bill data can be acquired from the updated bill data that has passed verification or the verification bill data corrected based on the verification bill data.

[0105] Based on the above data processing method, the application further provides a data processing apparatus. The apparatus will be described in detail below. Figure 5 The apparatus is described in detail.

[0106] Figure 5 A block diagram of an electronic device suitable for implementing the data processing method according to an embodiment of the application is schematically shown.

[0107] As shown in the figure, the data processing apparatus 500 comprises a storage module 510, a determination module 520 and a processing module 530. Figure 5

[0108] The storage module 510 is configured to, in response to detecting a plurality of newly added ticket services, transmit a plurality of to-be-processed fields generated in a process of processing the plurality of newly added ticket services and matching a preset field identifier to a message storage engine, wherein the to-be-processed field comprises the following subfields: a ticket belonging object, and each to-be-processed field is stored in a message topic library of the message storage engine corresponding to the ticket belonging object included in the to-be-processed field, and different message topic libraries correspond to different ticket belonging objects.

[0109] The determination module 520 is configured to determine target historical sub-data matching a plurality of message topic libraries from historical ticket data based on the ticket belonging objects corresponding to the plurality of message topic libraries respectively, wherein the historical ticket data is obtained by processing historical to-be-processed fields generated in a process of processing a plurality of historical newly added ticket services in a historical period.

[0110] The processing module 530 is configured to update the target historical sub-data matching the plurality of message topic libraries respectively based on the to-be-processed fields stored in the plurality of message topic libraries respectively, to obtain updated ticket data.

[0111] According to an embodiment of the present application, the target historical sub-data comprises a ticket statistical field. The processing module 530 comprises a first updating sub-module, a second updating sub-module and a third updating sub-module.

[0112] The first updating sub-module is configured to, for each message topic library, update a ticket statistical field included in the target historical sub-data matching the message topic library based on the to-be-processed field stored in the message topic library, to obtain intermediate updated sub-data.

[0113] The second updating sub-module is configured to add the to-be-processed field to the intermediate updated sub-data to obtain target updated sub-data.

[0114] The third updating sub-module is configured to obtain the updated ticket data based on the target updated sub-data corresponding to the plurality of message topic libraries respectively.

[0115] According to an embodiment of the present application, the to-be-processed field further comprises the following subfields: a ticket identifier, a ticket attribute and a ticket state. The historical ticket field included in the target historical sub-data comprises the following historical subfields: a historical ticket identifier and a historical ticket attribute. The first updating sub-module comprises a first updating unit and a second updating unit.

[0116] ​The first updating unit is configured to update the bill statistics field based on historical bill attributes to obtain an intermediate bill statistics field, in a case where it is determined that the bill identifier included in the to-be-processed field is inconsistent with the historical bill identifier.

[0117] The second updating unit is configured to update the intermediate bill statistics field based on the bill attributes and the bill state included in the to-be-processed field to obtain an intermediate updating sub-data.

[0118] According to an embodiment of the present application, the bill attributes include a bill expiration time point. The intermediate bill statistics field includes a total number of intermediate bills expiring within a target time period. The second updating unit includes an ordering sub-unit, a first determining sub-unit, a second determining sub-unit, a third determining sub-unit, and an updating unit.

[0119] The ordering sub-unit is configured to sort the plurality of to-be-processed fields according to the bill expiration time points in a case where the to-be-processed fields stored in the message topic library are a plurality of to-be-processed fields, to obtain a plurality of sorted to-be-processed fields.

[0120] The first determining sub-unit is configured to determine a boundary to-be-processed field with an expiration time point being a lower limit time point of the target time period from the plurality of sorted to-be-processed fields.

[0121] The second determining sub-unit is configured to determine at least one candidate to-be-processed field based on the boundary to-be-processed field and a preceding to-be-processed field, wherein the preceding to-be-processed field is a to-be-processed field with an expiration time point earlier than the lower limit time point in the plurality of sorted to-be-processed fields.

[0122] The third determining sub-unit is configured to determine a bill in an available state generated in a new bill business processing process based on a bill state included in the candidate to-be-processed field.

[0123] The updating unit is configured to update the total number of intermediate bills expiring within the target time period based on a quantity of bills in the available state to obtain intermediate bill data.

[0124] According to an embodiment of the present application, the data processing apparatus 500 further includes a range determining module, a generating module, and a sending module.

[0125] The range determining module is configured to determine a query range corresponding to a query interface address based on the query interface address included in the query request in response to receiving the query request sent by the target client.

[0126] The generating module is configured to generate the query bill data indicated by the query request based on the query bill field in the updated bill data matching the query range.

[0127] The sending module is configured to return the query bill data to the target client.

[0128] According to an embodiment of the present application, the storage module 510 comprises an identification determining submodule, a matching submodule and a transmission submodule.

[0129] The identification determining submodule is configured to determine, for each newly added bill business, a preset field identifier for the newly added bill business based on a business type of the newly added bill business.

[0130] The matching submodule is configured to match real-time bill data generated in a processing process of the newly added bill business with the preset field identifier to obtain a field to be processed.

[0131] The transmission submodule is configured to transmit the field to be processed to a message storage engine.

[0132] According to an embodiment of the present application, the data processing apparatus 500 further comprises an acquisition module, a processing module, a verification module and a correction module.

[0133] The acquisition module is configured to, in response to the updated bill data being the latest bill data in a first time period, acquire, from a bill data system, fields to be processed of a plurality of processed bill businesses processed in the first time period.

[0134] The processing module is configured to fuse and process the fields to be processed of the plurality of processed bill businesses and historical latest bill data obtained in a second time period to obtain verification bill data, wherein the second time period is earlier than the first time period, the historical latest bill data is obtained based on fields to be processed of a plurality of historical processed bill businesses processed in the second time period, the historical time period comprises the second time period, and the plurality of historical newly added bill businesses comprise the plurality of historical processed bill businesses.

[0135] The verification module is configured to verify the updated bill data by using the verification bill data to obtain a verification result.

[0136] The correction module is configured to, in a case where the verification result represents that the updated bill data fails to pass verification, correct the updated bill data based on the verification bill data to obtain corrected updated bill data.

[0137] According to an embodiment of the present application, any of the modules of the storing module 510, the determining module 520 and the processing module 530 can be combined in one module, or any of the modules can be split into multiple modules. Alternatively, at least part of the functions of one or more of the modules can be combined with at least part of the functions of the other modules, and implemented in one module. According to an embodiment of the present application, at least one of the storing module 510, the determining module 520 and the processing module 530 can be implemented at least in part as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on chip, a system on board, a system on package, an application specific integrated circuit (ASIC), or any other reasonable manner of integrating or packaging a circuit, etc. in hardware or firmware, or implemented in any one of the three implementation manners of software, hardware and firmware, or in a proper combination of any of the implementation manners. Alternatively, at least one of the storing module 510, the determining module 520 and the processing module 530 can be implemented at least in part as a computer program module which, when executed, can perform the corresponding functions.

[0138] Figure 6 A block diagram of an electronic device suitable for implementing the data processing method according to an embodiment of the present application is schematically shown.

[0139] As shown in Figure 6 The electronic device 600 according to an embodiment of the present application includes a processor 601 which can perform various appropriate actions and processes according to programs stored in a read only memory (ROM) 602 or loaded from a storage portion 608 into a random access memory (RAM) 603. The processor 601 can include, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and / or a related chipset and / or a special purpose microprocessor (e.g., an application specific integrated circuit (ASIC)), etc. The processor 601 can also include an on-board memory for cache use. The processor 601 can include a single processing unit or multiple processing units for executing different actions of the method processes according to embodiments of the present application.

[0140] In the RAM 603, various programs and data required for the operation of the electronic device 600 are stored. The processor 601, the ROM 602 and the RAM 603 are connected to each other through a bus 604. The processor 601 performs various operations of the method processes according to embodiments of the present application by executing the programs in the ROM 602 and / or the RAM 603. It should be noted that the programs can also be stored in one or more memories other than the ROM 602 and the RAM 603. The processor 601 can also perform various operations of the method processes according to embodiments of the present application by executing the programs stored in the one or more memories.

[0141] According to an embodiment of the present application, the electronic device 600 can further include an input / output (I / O) interface 605 that is also connected to the bus 604. The electronic device 600 can further include one or more of the following components connected to the input / output (I / O) interface 605: an input part 606 including a keyboard, a mouse, etc.; an output part 607 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage part 608 including a hard disk, etc.; and a communication part 606 including a network interface card such as a LAN card, a modem, etc. The communication part 606 performs communication processing via a network such as the Internet. A drive 610 is also connected to the input / output (I / O) interface 605 as necessary. A removable medium 611 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc. is mounted on the drive 610 as necessary, so that a computer program read out therefrom is installed in the storage part 608 as necessary.

[0142] The present application also provides a computer readable storage medium, which can be included in the device / apparatus / system described in the above embodiments, or can exist separately without being assembled into the device / apparatus / system. The above computer readable storage medium carries one or more programs, which, when executed, implement the method according to the embodiments of the present application.

[0143] According to an embodiment of the present application, the computer readable storage medium can be a non-volatile computer readable storage medium, which can include, but is not limited to, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any appropriate combination thereof. In the present application, the computer readable storage medium can be any tangible medium that contains or stores a program that can be used by or in connection with an instruction execution system, apparatus, or device. For example, according to an embodiment of the present application, the computer readable storage medium can include one or more memories such as the ROM 602 and / or the RAM 603 described above and / or one or more memory other than the ROM 602 and the RAM 603.

[0144] The embodiments of the present application also include a computer program product, which includes a computer program containing program codes for executing the method shown in the flow chart. When the computer program product is run in a computer system, the program codes are used to make the computer system implement the data processing method provided by the embodiments of the present application.

[0145] The above-described functions of the system / device defined in the system / apparatus of the embodiments of the present application are performed when the computer program is executed by the processor 601. According to the embodiments of the present application, the system, apparatus, module, unit, etc. described above can be implemented by the computer program modules.

[0146] In one embodiment, the computer program can be stored in a tangible storage medium, such as an optical, magnetic, or other memory on a hard disk drive, solid-state drive, or other storage device. In another embodiment, the computer program can be transmitted over a network, using a wireless or wired transmission medium, and downloaded and installed by the communication portion 606, and / or installed from the removable medium 611. The computer program code contained in the computer program can be executed using any suitable network medium, including but not limited to wireless, wireline, or any suitable combination of the above.

[0147] In such an embodiment, the computer program can be downloaded and installed from the network by the communication portion 606, and / or installed from the removable medium 611. The above-described functions of the system defined in the system of the embodiments of the present application are performed when the computer program is executed by the processor 601. According to the embodiments of the present application, the system, apparatus, module, unit, etc. described above can be implemented by the computer program modules.

[0148] According to the embodiments of the present application, the program code for carrying out the computer program provided by the embodiments of the present application can be written in any combination of one or more programming languages, and specifically, these computer programs can be implemented using high-level procedural and / or object-oriented programming language, and / or assembly / machine language. The programming language includes, but is not limited to, such as Java, C++, python, "C" language, or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on a remote computing device, or entirely on a remote computing device or server. In the case involving a remote computing device, the remote computing device can be connected to the user computing device through any kind of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, connected to the Internet through an Internet service provider).

[0149] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0150] Those skilled in the art will understand that the features described in the various embodiments of this application can be combined and / or combined in various ways, even if such combinations or combinations are not explicitly described in this application. In particular, the features described in the various embodiments of this application can be combined and / or combined in various ways without departing from the spirit and teachings of this application. All such combinations and / or combinations fall within the scope of this application.

Claims

1. A data processing method, characterized in that, The method includes: In response to the detection of multiple new invoice transactions, multiple fields to be processed that match the preset field identifier generated during the processing of the multiple new invoice transactions are transmitted to the message storage engine. The fields to be processed include the following sub-fields: the object to which the invoice belongs. Each field to be processed is stored in the message topic library of the message storage engine that corresponds to the object to which the invoice belongs, and different message topic libraries correspond to different objects to which the invoice belongs. Based on the ticket belonging to each of the multiple message topic libraries, target historical sub-data matching the multiple message topic libraries is determined from the historical ticket data. The historical ticket data is obtained by processing historical fields to be processed during the processing of multiple historical new ticket business in historical periods. Based on the fields to be processed stored in each of the multiple message topic libraries, the target historical sub-data that matches each of the multiple message topic libraries is updated in parallel to obtain the updated ticket data.

2. The method according to claim 1, characterized in that, The target historical sub-data includes the invoice statistics field; The step of updating the target historical sub-data that matches each of the multiple message topic libraries in parallel, based on the fields to be processed stored in each of the multiple message topic libraries, to obtain the updated ticket data includes: For each of the message topic libraries, based on the fields to be processed stored in the message topic library, the ticket statistics fields included in the target historical sub-data that matches the message topic library are updated to obtain intermediate updated sub-data; The field to be processed is added to the intermediate update sub-data to obtain the target update sub-data; The updated ticket data is obtained based on the target updated sub-data corresponding to each of the multiple message topic libraries.

3. The method according to claim 2, characterized in that, The fields to be processed also include the following subfields: bill identifier, bill attribute, and bill status; the target historical subdata includes the following historical subfields: historical bill identifier and historical bill attribute. Specifically, the step of updating the ticket statistics fields of the target historical sub-data that matches the message topic library based on the fields to be processed stored in the message topic library to obtain intermediate updated sub-data includes: If it is determined that the invoice identifier included in the field to be processed is inconsistent with the historical invoice identifier, the invoice statistics field is updated based on the historical invoice attributes to obtain the intermediate invoice statistics field; Based on the invoice attributes and invoice status included in the fields to be processed, the intermediate invoice statistics fields are updated to obtain the intermediate updated sub-data.

4. The method according to claim 3, characterized in that, The bill attributes include the bill maturity time; the intermediate bill statistics field includes the total number of intermediate bills maturing within the target period; Specifically, the step of updating the intermediate bill statistics field based on the bill attributes and bill status included in the field to be processed to obtain the intermediate updated sub-data includes: If there are multiple fields to be processed stored in the message topic library, sort the multiple fields to be processed according to the bill expiry time to obtain sorted multiple fields to be processed. From the sorted multiple fields to be processed, determine the boundary fields to be processed where the expiration time point is the lower limit time point of the target time period; Based on the boundary fields to be processed and the preceding fields to be processed, at least one candidate field to be processed is determined, wherein the preceding field to be processed is the field to be processed whose expiration time is earlier than the lower limit time among the sorted fields to be processed. Based on the bill status included in the candidate fields to be processed, determine the bills that are in an available state generated during the new bill business processing; Based on the number of bills in an available state, the total number of intermediate bills maturing within the target period is updated to obtain intermediate bill data.

5. The method according to claim 1, characterized in that, The method further includes: In response to receiving a query request from a target client, the query range corresponding to the query interface address is determined based on the query interface address included in the query request; Based on the query ticket fields in the updated ticket data that match the query range, the query ticket data indicated by the query request is generated; The queried ticket data is returned to the target client.

6. The method according to claim 1, characterized in that, The step of transmitting multiple fields to be processed that match preset field identifiers generated during the processing of multiple new invoice transactions to the message storage engine includes: For each new invoice transaction, a preset field identifier is determined based on the transaction type of the new invoice transaction. The real-time invoice data generated during the new invoice business processing is matched with the preset field identifier to obtain the field to be processed; The fields to be processed are transmitted to the message storage engine.

7. The method according to claim 1, characterized in that, The method further includes: In response to the updated invoice data being the latest invoice data in the first time period, the pending fields of multiple processed invoice transactions processed in the first time period are obtained from the invoice data system; The fields to be processed from multiple processed bill transactions are merged and processed with the latest historical bill data obtained in the second time period to obtain verified bill data. The second time period is earlier than the first time period. The latest historical bill data is obtained by processing the fields to be processed from multiple historical processed bill transactions processed in the second time period. The historical time period includes the second time period. The multiple historical newly added bill transactions include multiple historical processed bill transactions. The updated ticket data is verified using the verified ticket data to obtain the verification result. If the verification result indicates that the updated invoice data has failed verification, the updated invoice data is corrected based on the verified invoice data to obtain the corrected updated invoice data.

8. A data processing apparatus, characterized in that, The device includes: The storage module is used to transmit multiple fields to be processed that match the preset field identifier generated during the processing of multiple new ticket transactions to the message storage engine in response to the detection of multiple new ticket transactions. The fields to be processed include the following sub-fields: the ticket to which the object belongs. Each field to be processed is stored in the message topic library of the message storage engine that corresponds to the ticket to which the field to be processed is included. Different message topic libraries correspond to different ticket to which objects belong. The determination module is used to determine the target historical sub-data that matches the multiple message topic databases based on the ticket belonging objects corresponding to each of the multiple message topic databases. The historical ticket data is obtained by processing the historical fields to be processed generated during the processing of multiple historical new ticket business in historical periods. The processing module is used to update the target historical sub-data that matches each of the multiple message topic libraries in parallel, based on the fields to be processed stored in each of the multiple message topic libraries, to obtain the updated ticket data.

9. An electronic device, comprising: One or more processors; Memory, used to store one or more computer programs. The characteristic feature is that the one or more processors execute the one or more computer programs to implement the steps of the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program or instructions stored thereon, characterized in that, When the computer program or instructions are executed by a processor, they implement the steps of the method according to any one of claims 1 to 7.

11. A computer program product, comprising a computer program or instructions, characterized in that, When the computer program or instructions are executed by a processor, they implement the steps of the method according to any one of claims 1 to 7.

Images