Business data registration method and device, computer equipment and readable storage medium

Abstract

The invention relates to the field of big data processing, and particularly discloses a business data registration method and device, computer equipment and a readable storage medium. The method comprises the following steps: acquiring initial business data, registering the initial business data in a pre-constructed business data temporary table, identifying a business type of the initial business data, classifying and summarizing the initial business data according to the identified business type to obtain classified and summarized target business data, and determining a priority of the target business data, under the condition that the data volume of the target business data in the business data temporary table is greater than a preset data volume threshold value, adding a batch identifier to the target business data, and inserting the target business data added with the batch identifier into a pre-constructed business data sending table according to the priority of the target business data to obtain a plurality of records to be sent, and sending the plurality of records to be sent to a background data registration end to register target business data. By adopting the method, the business data registration efficiency can be improved.

Description

Technical Field

[0001] The present application relates to the technical field of big data processing, and in particular to a business data registration method, apparatus, computer equipment, computer-readable storage medium and computer program product. Background Art

[0002] In some business scenarios, it is usually necessary to receive business data through the front-end business terminal, and then send the business data to the back-end for registration and filing. With the gradual enrichment of business scenarios, in order to reduce the occurrence of missing data and wrong registration of data during the business data registration process, it is often adopted that after the front-end receives the business data, the business data is sent to the back-end in real time, and the back-end server performs a series of processing on the business data and finally writes it into the registration book.

[0003] However, although the traditional direct interaction between the front and back ends can ensure the real-time nature of data registration to a certain extent, it can also lead to excessively high frequency of data transmission between the front and back ends, and place high demands on the back-end server's ability to process data, especially during business peak periods, when the amount of business data is large and the frequency of front-end receiving business data is high. In this high-concurrency scenario, the back-end server is under great pressure and is prone to system delays or even crashes, resulting in inefficient business data registration. Summary of the invention

[0004] Based on this, it is necessary to provide a business data registration method, apparatus, computer equipment, computer-readable storage medium and computer program product that can improve the efficiency of business data registration in response to the above technical problems.

[0005] In a first aspect, the present application provides a business data registration method, comprising:

[0006] Acquire initial business data, and register the initial business data in a pre-built business data temporary table;

[0007] Identifying the business type of the initial business data, and classifying and aggregating the initial business data according to the identified business type to obtain the classified and aggregated target business data;

[0008] Determining the priority of the target business data;

[0009] When the data volume of the target business data in the business data temporary table is greater than a preset data volume threshold, a batch identifier is added to the target business data, and the target business data with the batch identifier is inserted into a pre-built business data sending table according to the priority of the target business data, to obtain a plurality of records to be sent;

[0010] Send the plurality of records to be sent to a background data registration terminal to register the target business data.

[0011] In one embodiment, the method further comprises:

[0012] Get the throughput of business data;

[0013] Determining the importance of the initial business data according to the business type of the initial business data;

[0014] The preset data volume threshold is adjusted according to the throughput and the importance.

[0015] In one embodiment, adjusting the preset data volume threshold according to the throughput and the importance includes:

[0016] Taking the throughput and the importance as input, calling a preset data volume threshold adjustment model to obtain a data volume threshold adjustment result;

[0017] According to the data volume threshold adjustment result, updating the preset data volume threshold;

[0018] The preset data volume threshold adjustment model is obtained through training based on historical throughput, the importance of historical initial business data, and historical data volume threshold.

[0019] In one embodiment, the method further comprises:

[0020] When the time interval from the last time the multiple records to be sent were sent to the background data registration terminal is greater than or equal to a preset time threshold, a batch identifier is added to the target business data, and according to the priority of the target business data, the target business data with the added batch identifier is inserted into the pre-built business data sending table to obtain multiple records to be sent.

[0021] In one embodiment, after sending the plurality of records to be sent to the background data registration terminal, the method further includes:

[0022] Receive registration status information fed back by the background data registration terminal;

[0023] When the registration status information indicates that the target business data is successfully registered, deleting the target business data carrying the batch identifier from the pre-built business data temporary table;

[0024] When the registration status information indicates that the target business data is registered abnormally, the batch identifier of the target business data is cleared from the pre-built business data temporary table so that the target business data is rolled back to the state before being inserted into the pre-built business data sending table.

[0025] In one of the embodiments, when the registration status information indicates that the target business data is successfully registered, the registration status information carries a batch identifier of the successfully registered target business data;

[0026] The deleting the target business data carrying the batch identifier from the pre-built business data temporary table includes:

[0027] Performing a consistency check on the batch identifier of the target business data in the pre-constructed temporary business data table and the batch identifier of the target business data successfully registered in the registration status information to obtain a consistency check result;

[0028] When the consistency check result indicates that the consistency check has passed, the target business data carrying the batch identifier is deleted from the pre-built business data temporary table.

[0029] In a second aspect, the present application also provides a business data registration device, including:

[0030] A data acquisition module, used to acquire initial business data and register the initial business data in a pre-built business data temporary table;

[0031] A classification and aggregation module, used for identifying the business type of the initial business data, and classifying and aggregating the initial business data according to the identified business type to obtain the classified and aggregated target business data;

[0032] A priority determination module, used to determine the priority of the target service data;

[0033] A data insertion module is used to add a batch identifier to the target business data when the data volume of the target business data in the business data temporary table is greater than a preset data volume threshold, and insert the target business data with the batch identifier into a pre-built business data sending table according to the priority of the target business data to obtain multiple records to be sent;

[0034] The data sending module is used to send the plurality of records to be sent to the background data registration terminal to register the target business data.

[0035] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps in the above-mentioned business data registration method embodiment when executing the computer program.

[0036] In a fourth aspect, the present application further provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above-mentioned business data registration method embodiment are implemented.

[0037] In a fifth aspect, the present application also provides a computer program product, including a computer program, which implements the steps in the above-mentioned business data registration method embodiment when executed by a processor.

[0038] The above-mentioned business data registration method, device, computer equipment, computer-readable storage medium and computer program product are different from the traditional scheme in which the front-end and back-end directly interact with each other in real time, which easily causes the back-end system to be overloaded in high-concurrency scenarios, affecting the data registration efficiency. This scheme introduces a data cache mechanism in the front-end server, temporarily stores the initial business data through a pre-constructed business data temporary table, and identifies the business type of the initial business data, so that the initial business data is classified and summarized according to the identified business type to obtain regular and orderly target business data, and further determines the priority of the target business data, so that even if there is a large amount of initial business data, the registration efficiency will not be affected by the excessively cumbersome and messy data volume. Then, when the amount of target business data in the business data temporary table reaches the preset data volume threshold, a batch identifier is added to the target business data, and the sending status of the target business data can be batch managed according to the batch identifier in the future, and the target business data with the batch identifier added can be inserted into the pre-constructed business data sending table according to the priority of the target business data, and multiple records to be sent are sent in batches to the back-end data registration, which simplifies the business data registration process, reduces the number of interactions between the front-end and back-end, and enables the back-end server to adapt to the high-concurrency data registration needs. Furthermore, unlike the traditional real-time registration mode, in which business data is only sent in the order of generation time without distinguishing the priority of business data, which may cause important data to be overwhelmed by ordinary data and delay processing time, in this solution, the target business data is also sorted according to its priority, and the process of sending target business data from the front-end terminal to the back-end data registration terminal is optimized, so that high-priority target business data can be processed first during batch sending and registration. Even when the load demand of the back-end server is high, the registration of high-priority target business data can be delayed as little as possible, thereby improving the timeliness and efficiency of business data registration. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0040] Figure 1 An application environment diagram of a business data registration method in an embodiment;

[0041] Figure 2 A schematic diagram of a process flow of a business data registration method in an embodiment;

[0042] Figure 3 A schematic diagram of a process flow of a business data registration method in a simple embodiment;

[0043] Figure 4 is a flow chart of a business data registration method in another embodiment;

[0044] Figure 5 It is a flowchart of a method for registering business data in another embodiment;

[0045] Figure 6 A flowchart of a business data registration method in another embodiment;

[0046] Figure 7 A flowchart of a business data registration method in a detailed embodiment;

[0047] Figure 8 is a structural block diagram of a service data registration device in one embodiment;

[0048] Fig. 9 It is a structural block diagram of a service data registration device in another embodiment;

[0049] Fig.10 A structural block diagram of a service data registration device in yet another embodiment;

[0050] Fig.11 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0051] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application. It should be noted that in the embodiments of the present application, certain software, components, models and other existing solutions in the industry may be mentioned, which should be considered as exemplary, and their purpose is only to illustrate the feasibility of the implementation of the technical solution of the present application, but it does not mean that the applicant has or will necessarily use the solution.

[0052] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations. The acquisition, storage, use, and processing of data in the technical solution of this application are in compliance with relevant provisions of national laws and regulations.

[0053] The service data registration method provided in the embodiment of the present application can be applied to Figure 1 In the application environment shown, the front-end server 102 communicates with the back-end data registration terminal 104 through the network. The data storage system can store the data that the front-end server 102 needs to process. The data storage system can be integrated on the front-end server 102, or it can be placed on the cloud or other network servers.

[0054] Specifically, in a business processing scenario, the staff may upload the initial business data to the front-end server 102 in real time through the front-end terminal. The front-end server 102 may register the initial business data in a pre-built business data temporary table, and then identify the business type of the initial business data. According to the identified business type, the initial business data is classified and summarized to obtain the classified and summarized target business data, and the priority of the target business data is determined. Furthermore, when the data volume of the target business data in the business data temporary table is greater than a preset data volume threshold, a batch identifier is added to the target business data. According to the priority of the target business data, the target business data with the batch identifier is inserted into the pre-built business data sending table to obtain multiple records to be sent. Finally, the front-end server 102 sends the multiple records to be sent to the back-end data registration terminal 104 to register the target business data.

[0055] Among them, the front-end server 102 and the back-end data registration terminal 104 can be independent physical servers, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud computing services.

[0056] In an exemplary embodiment, Figure 2 As shown, a business data registration method is provided, which is applied to Figure 1 Taking the front-end server 102 in the example as an example, the following steps are included:

[0057] S100, obtaining initial business data, and registering the initial business data in a pre-built temporary business data table.

[0058] Among them, initial business data refers to unprocessed business data generated in the process of processing business. Taking the financial industry as an example, initial business data includes but is not limited to customer transaction requests, account changes and other data. Taking the power industry as an example, initial business data includes but is not limited to the operating data of each power equipment in the power plant, power generation data, power load data and other data. The pre-built business data temporary table is equivalent to a short-term data storage area. In order to explain this solution more clearly, the following explanation will be given by taking the application of this solution in the financial industry as an example.

[0059] Taking the example of a front-end server processing a customer transaction request, the front-end server can register the customer's account information, transaction conditions, transaction time and other initial business data in a pre-built temporary business data table. The front-end server can quickly access, read and update the initial business data in the temporary business data table.

[0060] S200, identifying the business type of the initial business data, and classifying and aggregating the initial business data according to the identified business type to obtain the classified and aggregated target business data.

[0061] In the financial industry, business types include but are not limited to transfer business, loan business, securities trading, foreign exchange exchange and other businesses. It can also be personal business, corporate business, etc.

[0062] Exemplarily, the front-end server can identify the business type of the initial business data based on the key fields in the initial business data, for example, the initial business data can be divided into personal business and corporate business, and further divided into transfer business, loan business, etc. for personal business or corporate business, so as to classify and summarize the initial business data to obtain the target business data. Furthermore, the pre-built temporary table of business data can be a multi-level temporary table structure. After the front-end server classifies and summarizes the initial business data, the target business data obtained by classification and summary can be stored in different areas of the temporary table of business data, thereby improving the speed of subsequent possible data search and data transmission.

[0063] S300, determining the priority of target business data.

[0064] Among them, the priority of target business data can be determined based on business urgency, business type, etc. For example, the priority of target business data for large transactions is higher than that of target business data for small transactions, and the priority of target business data with a short transaction validity period is higher than that of target business data with a long transaction validity period.

[0065] For example, the front-end server can first identify the service validity period field and the service type field from the target service data, and then prioritize the target service data according to the service validity period field and the service type field. In addition, a trained deep learning model can be introduced to dynamically adjust the priority of the target service data.

[0066] S400, determining whether the data volume of target business data in the business data temporary table is greater than a preset data volume threshold.

[0067] Following the above steps, determine whether the data volume of the target business data in the business data temporary table is greater than the preset data volume threshold. That is to say, when the data volume of the target business data in the business data temporary table reaches a certain value, the sending condition is triggered, and this batch of target business data can be uniformly sent to the background data registration terminal, thereby reducing the number of interactions between the front-end server and the background data registration terminal.

[0068] In addition, the preset data volume threshold should be smaller than the maximum data volume that can be carried in the business data temporary table, so that the newly generated target business data can still be registered in the business data temporary table during the batch sending process of the target business data in the business data temporary table.

[0069] S500, adding a batch identifier to the target business data, inserting the target business data with the batch identifier into a pre-built business data sending table according to the priority of the target business data, obtaining multiple records to be sent, and sending the multiple records to be sent to the background data registration terminal.

[0070] Among them, the batch identifier is used to uniquely represent the batch of target business data, and is used to batch manage the target business data in subsequent data approval, data tracking, data rollback and other links.

[0071] Following the above steps, when the amount of target business data in the temporary business data table is greater than the preset data amount threshold, a unified batch identifier is added to the target business data in the temporary business data table to indicate that this batch of target business data is processed in the same batch. Further, according to the priority of the target business data, these target business data with batch identifiers are inserted into the pre-built business data sending table, and multiple records to be sent are generated and sent to the background data registration terminal.

[0072] For example, the front-end server needs to process the target business data, which is the customer's loan application data. When the amount of the loan application data is greater than the preset data amount threshold, the front-end server will add a data identifier to this batch of loan application data, and insert the loan application data into the business data sending table according to the priority of the loan application data, forming a series of records to be sent, among which high-amount loan application data can be inserted into the business data sending table first, so that after sending the records to be sent to the background data registration terminal, the background data registration terminal can register the high-amount loan application data first. Then, the front-end server scans the records to be sent, calls the interface of the background data registration terminal, sends the records to be sent to the background data registration terminal, and changes the data status of the records to be sent to sent.

[0073] The above-mentioned business data registration method is different from the traditional scheme in which the front-end and back-end directly interact with each other in real time. In a high-concurrency scenario, it is easy to cause the back-end system to be overloaded, affecting the data registration efficiency. This scheme introduces a data cache mechanism in the front-end server, and temporarily stores the initial business data through a pre-built business data temporary table, and identifies the business type of the initial business data, so that the initial business data is classified and summarized according to the identified business type, and regular and orderly target business data is obtained, and the priority of the target business data is further determined, so that even if there is a large amount of initial business data, the registration efficiency will not be affected by the excessively cumbersome and messy data volume. Then, when the amount of target business data in the business data temporary table reaches the preset data volume threshold, a batch identifier is added to the target business data, and the sending status of the target business data can be batch managed according to the batch identifier in the future, and according to the priority of the target business data, the target business data with the batch identifier added is inserted into the pre-built business data sending table, and multiple records to be sent are sent in batches to the back-end data registration, which simplifies the business data registration process, reduces the number of interactions between the front-end and back-end, and enables the back-end server to adapt to the high-concurrency data registration needs. Furthermore, unlike the traditional real-time registration mode, in which business data is only sent in the order of generation time without distinguishing the priority of business data, which may cause important data to be overwhelmed by ordinary data and delay processing time, in this solution, the target business data is also sorted according to its priority, and the process of sending target business data from the front-end terminal to the back-end data registration terminal is optimized, so that high-priority target business data can be processed first during batch sending and registration. Even when the load demand of the back-end server is high, the registration of high-priority target business data can be delayed as little as possible, thereby improving the timeliness and efficiency of business data registration.

[0074] In an exemplary embodiment, Figure 3 As shown, the method also includes:

[0075] S600, obtaining the throughput of the service data, and determining the importance of the initial service data according to the service type of the initial service data.

[0076] S700, adjust the preset data volume threshold according to the throughput and importance.

[0077] The throughput of business data refers to the amount of business data that the front-end server can process per unit time. For example, during peak business hours, the business data that the front-end server needs to process increases significantly, and the throughput of business data increases. During low business hours, the business data that the front-end server needs to process decreases, and the throughput of business data decreases.

[0078] Specifically, if the front-end server is processing a large amount of initial business data, this means that the throughput of the business data of the front-end server is high. At this time, the preset data volume threshold can be appropriately increased to reduce the number of transmissions between the front-end server and the back-end data registration terminal, and as many target business data as possible can be sent in one transmission batch to improve the registration efficiency of the target business data. If the business is in a low period at this time, the business data throughput of the front-end server is low, and the preset data volume threshold can be appropriately lowered so that the target business data can be sent to the back-end data registration terminal as soon as possible to improve the real-time registration of business data.

[0079] Furthermore, the preset data volume threshold can also be adjusted according to the importance of the initial business data. Exemplarily, it is assumed that the initial business data being processed by the front-end server includes but is not limited to various types of transaction data such as instant transfer data and loan application data. Since loan applications usually involve a more complicated approval process, it can be considered that the importance of loan application data is higher than that of instant transfer data. When most of the initial business data is loan application data, the front-end server recognizes that the importance of the initial business data has increased, and thus adaptively reduces the preset data volume threshold, so that important business data can be registered by the background data registration terminal in a timely manner. If most of the initial business data are instant transfer data for small transfers, the front-end server recognizes that the importance of the initial business data has decreased, and thus adaptively increases the preset data volume threshold, further reducing the number of data interactions between the front-end server and the background data registration terminal, and improving the efficiency of business data registration.

[0080] In this embodiment, by adaptively adjusting the preset data volume threshold according to the throughput of the business data and the importance of the initial business data, the front-end server can effectively respond to fluctuating business demands. In the case of high throughput or the initial business data has a low importance, the preset data volume threshold is appropriately increased to improve the efficiency of business data registration. In the case of low throughput or the initial business data has a high importance, the preset data volume threshold is appropriately lowered to improve the real-time nature of business data registration.

[0081] In an exemplary embodiment, Figure 4 As shown, S700 includes:

[0082] S710, taking the throughput and the importance as input, calling a preset data volume threshold adjustment model to obtain a data volume threshold adjustment result.

[0083] S720: Update the preset data volume threshold according to the data volume threshold adjustment result.

[0084] The preset data volume threshold adjustment model is trained based on historical throughput, the importance of historical initial business data, and the historical data volume threshold. In addition, the historical data volume threshold is usually a data volume threshold that makes business data registration efficient and real-time.

[0085] Following the above embodiment, the front-end server uses the throughput of business data and the importance of initial business data as input to call the data volume threshold adjustment model. Since the data volume threshold adjustment model has learned the relationship between throughput, importance and data volume threshold during the training process, the data volume threshold adjustment result output by the data volume threshold adjustment model can quickly, efficiently and accurately obtain the data volume threshold adjustment result that makes business data registration efficient and real-time. Furthermore, after obtaining the data volume threshold adjustment result, the preset data volume threshold is updated in time, so that the updated data volume threshold can better adapt to the current business needs.

[0086] In this embodiment, by introducing deep learning model technology, the front-end server can adjust the data volume threshold more efficiently and accurately, improve the front-end server's ability to adapt to different business needs, and find a balance between improving the efficiency of business data registration and the real-time performance of business data registration.

[0087] In an exemplary embodiment, Figure 5 As shown, the method also includes:

[0088] S800, determining whether the time interval from the last time a plurality of records to be sent were sent to the background data registration terminal is greater than or equal to a preset time threshold.

[0089] Continuing from the above embodiment, the front-end server determines whether the time interval from the last time multiple records to be sent were sent to the background data registration terminal is greater than or equal to the preset time threshold. If the time interval from the last time multiple records to be sent were sent to the background data registration terminal is greater than or equal to the preset time threshold, a batch identifier is added to the target business data. According to the priority of the target business data, the target business data with the batch identifier is inserted into the pre-built business data sending table to obtain multiple records to be sent.

[0090] Exemplarily, the preset time threshold can be 20 minutes, that is, since the last time multiple records to be sent were sent to the background data registration terminal, if within 20 minutes, even if the amount of data newly written into the business data temporary table by the front-end server has not reached the data amount threshold, once the time interval reaches 20 minutes, the front-end server will still add a batch identifier to the target business data in the business data temporary table, and then insert the target business data with the batch identifier into the business data sending table according to the priority of the target business data, so as not to delay the timeliness of the target business data. Even during the business low period, the target business data can be sent to the background data registration terminal in time.

[0091] It should be noted that the preset time threshold in this embodiment can also be adaptively adjusted. For example, the preset time threshold can be flexibly adjusted through a deep learning model or other adaptive algorithms based on data such as the throughput of the business data of the front-end server and the importance of the initial business data.

[0092] In this embodiment, by setting a preset time threshold, the front-end server and the back-end data registration terminal can perform reasonable data interaction. During business low periods, the time interval is used as a judgment condition for whether to send target business data, which can improve the timeliness of business data registration and improve the efficiency of business data registration.

[0093] In an exemplary embodiment, Figure 5 As shown, after S500, the method further includes:

[0094] S910, receiving registration status information fed back by the background data registration terminal.

[0095] S920: When the registration status information indicates that the target business data is successfully registered, the target business data carrying the batch identifier is deleted from the pre-built business data temporary table.

[0096] S930: When the registration status information indicates that the target business data is registered abnormally, the batch identifier of the target business data is cleared from the pre-built business data temporary table.

[0097] Following the above embodiment, after the background data registration terminal receives the target business data sent by the front-end server, it registers the target business data and feeds back the registration status information of the target business data to the front-end server. For example, if the target business data is successfully registered, the corresponding registration status information may be "registration successful" with the relevant registration time, registration area, etc.; if the target business data fails to be registered, the corresponding registration status information may be "registration failed" with the reason for the registration failure, such as registration failure due to network reasons, data format of the target business data does not conform, insufficient memory, etc. In addition, if the registration of the target business data fails, an alarm message may be sent to the relevant responsible personnel to remind the relevant responsible personnel to promptly handle the target business data that failed to be registered.

[0098] Specifically, when the registration status information indicates that the target business data has been successfully registered, this means that the target business data has been stored in the database of the background data registration end and can be deleted from the business data temporary table. Therefore, the front-end server will delete the target business data carrying the batch identifier from the business data temporary table to free up storage space and reduce data redundancy.

[0099] When the registration status information indicates that the registration of the target business data has failed, the front-end server will delete the batch identifier of this batch of target business data. This is to roll back the target business data to the state before the batch identifier was added. In subsequent operations, the front-end server will not mistakenly believe that these data have been successfully registered, but will re-add batch identifiers to these target business data and re-send these target business data to the background data registration terminal, thereby reducing potential data conflicts and business process confusion.

[0100] For example, the target business data is a batch of transfer data. When the front-end server sends the transfer data with a batch identifier to the back-end data registration terminal, the back-end data registration terminal does not receive the batch of transfer data due to network reasons. Therefore, the back-end data registration terminal feedbacks the registration status information of failed registration. At this time, the front-end server will delete the batch identifier of this batch of transfer data, so that the transfer data will be rolled back to the state before the batch identifier was added, so that it can be resent later. In addition, if an exception occurs during the process of deleting the batch identifier, such as a network failure that makes it impossible to delete the batch identifier, the front-end server can retry a preset number of times. If the batch identifier still cannot be deleted, the target business data will be initialized and rolled back to the data state before classification and aggregation, waiting for further processing later.

[0101] In this embodiment, through the registration status information fed back by the background data registration terminal, the front-end server can take exception handling measures in time in the case of registration abnormalities. By clearing the batch identifier of the target business data that sent the exception, the data status of the target business data can be quickly rolled back to the state before the batch identifier was added without affecting other threads running simultaneously, thereby improving the business data registration efficiency and the consistency of the business data registration process.

[0102] In an exemplary embodiment, Figure 6 As shown, S920 includes:

[0103] S921, performing consistency check on the batch identifier of the target business data in the pre-built business data temporary table and the batch identifier of the target business data successfully registered in the registration status information to obtain a consistency check result.

[0104] S922: When the consistency check result indicates that the consistency check has passed, the target business data carrying the batch identifier is deleted from the pre-built business data temporary table.

[0105] Continuing from the above embodiment, when the registration status information indicates that the target business data has been successfully registered, the registration status information will carry the batch identifier of the target business data that has been successfully registered. The front-end server needs to delete the target business data carrying the batch identifier from the pre-built business data temporary table. Before that, it is necessary to first perform a consistency check on the batch identifier of the target business data in the business data temporary table and the batch identifier of the target business data that has been successfully registered in the registration status information to obtain a consistency check result.

[0106] When the consistency check result indicates that the consistency check has passed, this means that the target business data sent by the front-end server is consistent with the target business data registered on the back-end data registration end. The target business data carrying the batch identifier in the business data temporary table can be deleted to reduce the resources of the business data temporary table occupied by the registered target business data.

[0107] If the consistency check fails, it means that data loss, data errors, duplicate data registration, etc. may have occurred during the sending and registration process of the target business data. At this time, the target business data with batch identifiers cannot be deleted from the pre-built business data temporary table. At this time, the front-end server can roll back to the state before sending the target business data, and the back-end data registration end can roll back to the state before registering the received target business data, and send an alarm message to the relevant responsible personnel.

[0108] In this embodiment, before deleting the target business data carrying a batch identifier, a consistency check is performed on the batch identifier of the target business data in the business data temporary table and the batch identifier of the target business data successfully registered in the registration status information. The corresponding target business data is deleted only if the consistency check passes, thereby improving the consistency of data during the business data registration process.

[0109] In order to make a clearer description of the business data registration method provided by the present application, the following is a specific embodiment and the attached Figure 7 To illustrate, this specific embodiment includes the following steps:

[0110] S701, obtaining initial business data, and registering the initial business data in a pre-built business data temporary table.

[0111] S702, identifying the business type of the initial business data, and classifying and aggregating the initial business data according to the identified business type to obtain the classified and aggregated target business data.

[0112] S703, determine the priority of the target service data.

[0113] S704, determining whether the data volume of the target business data in the business data temporary table is greater than a preset data volume threshold, or whether the time interval from the last time a plurality of records to be sent were sent to the background data registration terminal is greater than or equal to a preset time threshold.

[0114] S705, adding a batch identifier to the target business data, inserting the target business data with the batch identifier into a pre-built business data sending table according to the priority of the target business data, obtaining multiple records to be sent, and sending the multiple records to be sent to the background data registration terminal.

[0115] S706, receiving registration status information fed back by the background data registration terminal.

[0116] S707, performing consistency check on the batch identifier of the target business data in the pre-built temporary business data table and the batch identifier of the successfully registered target business data in the registration status information to obtain a consistency check result.

[0117] S708, when the consistency check result indicates that the consistency check has passed, the target business data carrying the batch identifier is deleted from the pre-built business data temporary table.

[0118] S709, when the registration status information indicates that the target business data is registered abnormally, clear the batch identifier of the target business data from the pre-built business data temporary table.

[0119] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0120] Based on the same inventive concept, the embodiment of the present application also provides a business data registration device for implementing the business data registration method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more business data registration device embodiments provided below can refer to the limitations on the business data registration method above, and will not be repeated here.

[0121] In an exemplary embodiment, Figure 8 As shown, a business data registration device 800 is provided, comprising: a data acquisition module 801, a classification and aggregation module 802, a priority determination module 803, a data insertion module 804 and a data sending module 805, wherein:

[0122] The data acquisition module 801 is used to acquire initial business data and register the initial business data in a pre-built temporary business data table.

[0123] The classification and aggregation module 802 is used to identify the business type of the initial business data, and classify and aggregate the initial business data according to the identified business type to obtain the classified and aggregated target business data.

[0124] The priority determination module 803 is used to determine the priority of target service data.

[0125] The data insertion module 804 is used to add a batch identifier to the target business data when the data volume of the target business data in the business data temporary table is greater than the preset data volume threshold, and insert the target business data with the batch identifier into the pre-built business data sending table according to the priority of the target business data to obtain multiple records to be sent.

[0126] The data sending module 805 is used to send multiple records to be sent to the background data registration terminal to register the target business data.

[0127] In an exemplary embodiment, Fig. 9 As shown, the business data registration device 800 also includes a data volume threshold adjustment module 806, which is used to obtain the throughput of business data, determine the importance of the initial business data according to the business type of the initial business data, and adjust the preset data volume threshold according to the throughput and importance.

[0128] In an exemplary embodiment, the data volume threshold adjustment module 806 is also used to call a preset data volume threshold adjustment model with throughput and importance as input, obtain a data volume threshold adjustment result, and update the preset data volume threshold according to the data volume threshold adjustment result, wherein the preset data volume threshold adjustment model is trained based on historical throughput, the importance of historical initial business data, and historical data volume thresholds.

[0129] In an exemplary embodiment, the data insertion module 804 is also used to add a batch identifier to the target business data when the time interval from the last time a plurality of records to be sent was sent to the background data registration terminal is greater than or equal to a preset time threshold, and insert the target business data with the batch identifier into a pre-built business data sending table according to the priority of the target business data to obtain a plurality of records to be sent.

[0130] In an exemplary embodiment, Fig.10 As shown, the device also includes a data deletion module 807, which is used to receive registration status information fed back by the background data registration terminal. When the registration status information indicates that the target business data is successfully registered, the target business data carrying the batch identifier is deleted from the pre-built business data temporary table. When the registration status information indicates that the target business data is registered abnormally, the batch identifier of the target business data is cleared from the pre-built business data temporary table to roll back the target business data to the state before it is inserted into the pre-built business data sending table.

[0131] In an exemplary embodiment, when the registration status information indicates that the target business data has been successfully registered, the registration status information carries the batch identifier of the successfully registered target business data. The data deletion module 807 is also used to perform a consistency check on the batch identifier of the target business data in the pre-built business data temporary table and the batch identifier of the successfully registered target business data in the registration status information to obtain a consistency check result. When the consistency check result indicates that the consistency check has passed, the target business data carrying the batch identifier is deleted from the pre-built business data temporary table.

[0132] Each module in the above-mentioned business data registration device can be implemented in whole or in part by software, hardware and their combination. Each module can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the corresponding operations of each module above.

[0133] In an exemplary embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. Fig.11 As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data such as initial business data. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a business data registration method is implemented.

[0134] Those skilled in the art will understand that Fig.11 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0135] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above-mentioned business data registration method embodiment when executing the computer program.

[0136] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned business data registration method embodiment are implemented.

[0137] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above-mentioned business data registration method embodiment when executed by a processor.

[0138] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0139] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0140] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A business data registration method, characterized in that: The method comprises: Acquire initial business data, and register the initial business data in a pre-built business data temporary table; Identifying the business type of the initial business data, and classifying and aggregating the initial business data according to the identified business type to obtain the classified and aggregated target business data; Determining the priority of the target business data; When the data volume of the target business data in the business data temporary table is greater than a preset data volume threshold, a batch identifier is added to the target business data, and the target business data with the batch identifier is inserted into a pre-built business data sending table according to the priority of the target business data, to obtain a plurality of records to be sent; Send the plurality of records to be sent to a background data registration terminal to register the target business data.

2. The method according to claim 1, characterized in that The method further comprises: Get the throughput of business data; Determining the importance of the initial business data according to the business type of the initial business data; The preset data volume threshold is adjusted according to the throughput and the importance.

3. The method according to claim 2, characterized in that The adjusting the preset data volume threshold according to the throughput and the importance includes: Taking the throughput and the importance as input, calling a preset data volume threshold adjustment model to obtain a data volume threshold adjustment result; According to the data volume threshold adjustment result, updating the preset data volume threshold; The preset data volume threshold adjustment model is obtained through training based on historical throughput, the importance of historical initial business data, and historical data volume threshold.

4. The method according to claim 1, characterized in that: The method further comprises: When the time interval from the last time the multiple records to be sent were sent to the background data registration terminal is greater than or equal to a preset time threshold, a batch identifier is added to the target business data, and according to the priority of the target business data, the target business data with the added batch identifier is inserted into the pre-built business data sending table to obtain multiple records to be sent.

5. The method according to any one of claims 1 to 4, characterized in that: After sending the plurality of records to be sent to the background data registration terminal, the method further includes: Receive registration status information fed back by the background data registration terminal; When the registration status information indicates that the target business data is successfully registered, deleting the target business data carrying the batch identifier from the pre-built business data temporary table; When the registration status information indicates that the target business data is registered abnormally, the batch identifier of the target business data is cleared from the pre-built business data temporary table so that the target business data is rolled back to the state before being inserted into the pre-built business data sending table.

6. The method according to claim 5, characterized in that In the case where the registration status information indicates that the target service data is successfully registered, the registration status information carries a batch identifier of the successfully registered target service data; The deleting the target business data carrying the batch identifier from the pre-built business data temporary table includes: Performing a consistency check on the batch identifier of the target business data in the pre-constructed temporary business data table and the batch identifier of the target business data successfully registered in the registration status information to obtain a consistency check result; When the consistency check result indicates that the consistency check has passed, the target business data carrying the batch identifier is deleted from the pre-built business data temporary table.

7. A business data registration device, characterized in that: The device comprises: A data acquisition module, used to acquire initial business data and register the initial business data in a pre-built business data temporary table; A classification and aggregation module, used for identifying the business type of the initial business data, and classifying and aggregating the initial business data according to the identified business type to obtain the classified and aggregated target business data; A priority determination module, used to determine the priority of the target service data; A data insertion module is used to add a batch identifier to the target business data when the data volume of the target business data in the business data temporary table is greater than a preset data volume threshold, and insert the target business data with the batch identifier into a pre-built business data sending table according to the priority of the target business data to obtain multiple records to be sent; The data sending module is used to send the plurality of records to be sent to the background data registration terminal to register the target business data.

8. The device according to claim 7, characterized in that The device also includes a data volume threshold adjustment module, which is used to obtain the throughput of business data, determine the importance of the initial business data according to the business type of the initial business data, and adjust the preset data volume threshold according to the throughput and the importance.

9. The device according to claim 8, characterized in that The data volume threshold adjustment module is also used to call a preset data volume threshold adjustment model with the throughput and the importance as input, obtain a data volume threshold adjustment result, and update the preset data volume threshold according to the data volume threshold adjustment result, wherein the preset data volume threshold adjustment model is trained based on historical throughput, the importance of historical initial business data, and historical data volume threshold.

10. The device according to claim 7, characterized in that The data insertion module is also used to add a batch identifier to the target business data when the time interval from the last time the multiple records to be sent were sent to the background data registration terminal is greater than or equal to a preset time threshold, and insert the target business data with the batch identifier into a pre-built business data sending table according to the priority of the target business data to obtain multiple records to be sent.

11. The device according to any one of claims 7 to 10, characterized in that The device also includes a data deletion module, which is used to receive registration status information fed back by the background data registration terminal. When the registration status information indicates that the target business data is successfully registered, the target business data carrying the batch identifier is deleted from the pre-constructed business data temporary table. When the registration status information indicates that the target business data is abnormally registered, the batch identifier of the target business data is cleared from the pre-constructed business data temporary table, so that the target business data is rolled back to the state before being inserted into the pre-constructed business data sending table.

12. The device according to claim 11, characterized in that When the registration status information indicates that the target business data has been successfully registered, the registration status information carries the batch identifier of the successfully registered target business data, and the data deletion module is further used to perform a consistency check on the batch identifier of the target business data in the pre-built business data temporary table and the batch identifier of the successfully registered target business data in the registration status information to obtain a consistency check result, and when the consistency check result indicates that the consistency check has passed, the target business data carrying the batch identifier is deleted from the pre-built business data temporary table.

13. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

14. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

15. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images