Data updating method and related equipment

Abstract

The invention discloses a data updating method and related equipment, which are applied to the field of data processing, and the method comprises the following steps: in response to a data quality problem detected by a data supply system, determining first data influenced by the data quality problem and a data application system using the first data, generating a collaborative work order according to the first data; repairing the data quality problem to obtain second data and a first repair verification result corresponding to the second data, sending the collaborative work order to the data application system, and sending the second data to a data warehouse system; receiving a second repair verification result sent by the data application system; and in response to matching of the first repair verification result and the second repair verification result, determining that the data supply system, the data warehouse system and the data application system cooperatively complete data updating. According to the invention, the operation stability of the data warehouse system is improved.

Description

Technical Field

[0001] The present application belongs to the field of data processing technology, and in particular, relates to a data updating method and related equipment. Background Art

[0002] In the era of big data, all transaction data can be analyzed and summarized to extract useful information. In the data chain of analysis, summary and extraction, the system that generates data is the data supply system, the system that analyzes, summarizes and extracts data is the data application system, and the system that stores data is the data warehouse system.

[0003] During the operation of the data supply system, if erroneous data appears, the erroneous data will be stored in the data warehouse system, causing the data application system to use the erroneous data for application.

[0004] In the exemplary technology, the data warehouse system generally sends inspection requests to the data supply system in a periodic polling manner, so that the data supply system finds erroneous data, and the data warehouse system then directs the data supply system and the data application system to modify and update the erroneous data.

[0005] However, the data warehouse system is connected to multiple data supply systems and data application systems. The data warehouse system dominates the data supply systems and data application systems. Modification and updating of erroneous data will cause the workload of the data warehouse system to be too heavy, making the data warehouse system unstable. In other words, data updates lead to poor operating stability of the data warehouse system. Summary of the invention

[0006] The embodiments of the present application provide a data updating method and related devices for solving the problem that data updating causes poor operational stability of a data warehouse system.

[0007] In a first aspect, an embodiment of the present application provides a data updating method, which is applied to a data provision system. The data updating method includes:

[0008] In response to the data supply system detecting a data quality problem, determining first data affected by the data quality problem and a data application system using the first data, and generating a collaborative work order based on the first data;

[0009] Repairing the data quality problem to obtain second data and a first repair verification result corresponding to the second data, sending the collaborative work order to the data application system, and sending the second data to the data warehouse system;

[0010] receiving a second repair verification result sent by the data application system, wherein the second repair verification result is used to indicate the result obtained by the data application system of repairing the data based on third data obtained from the data warehouse system by the collaborative work order, wherein the third data is data obtained by the data warehouse system updating the first data based on the second data;

[0011] In response to the first repair verification result matching the second repair verification result, it is determined that the data supply system, the data warehouse system, and the data application system collaboratively complete data updating.

[0012] In one embodiment, the step of determining a data application system using the first data includes:

[0013] Generate a data acquisition request according to the data quality problem, and send the data acquisition request to the data warehouse system;

[0014] receiving list information sent by the data warehouse system based on the data sending request, the list information including systems using the first data;

[0015] A data application system using the first data is determined according to the list information.

[0016] In another embodiment, the step of generating a collaborative work order according to the first data includes:

[0017] According to the list information, determining in the data warehouse system fourth data associated with the first data, wherein the fourth data is data obtained by processing the first data;

[0018] A collaborative work order is generated according to the first data and the fourth data.

[0019] In another embodiment, the step of repairing the data quality problem to obtain the second data includes:

[0020] Generate a repair strategy control table according to the data quality problem;

[0021] Sending the repair strategy control table to the audit terminal;

[0022] receiving the audit result of the repair strategy control table by the audit terminal;

[0023] In response to the audit result being that the audit is passed, the data quality problem is repaired according to the repair strategy control table to obtain second data.

[0024] In another embodiment, after the step of receiving the second repair verification result sent by the data application system, the method further includes:

[0025] In response to the first repair verification result not matching the second repair verification result, sending a data acquisition instruction to the data application system;

[0026] Receiving first repair record information fed back by the data application system based on the data acquisition instruction, and obtaining second repair record information obtained by the data supply system repairing the data quality problem;

[0027] Generate repair report information according to the first repair record information and the second repair record information, and send the repair report information to a terminal associated with a repair person.

[0028] In a second aspect, an embodiment of the present application further provides a data updating method, which is applied to a data warehouse system, and is characterized in that the data updating method comprises:

[0029] receiving second data sent by a data supply system, and determining first data corresponding to the second data in the data warehouse system, wherein the first data is data with data quality problems stored in the data warehouse system by the data supply system, and the second data is data obtained by repairing the data quality problems;

[0030] updating the first data according to the second data to obtain third data, and sending data update completion information to the data application system;

[0031] A data acquisition request fed back by the data application system based on the data update completion information is received, and the third data is sent to the data application system, so that the data application system performs data update based on the third data.

[0032] In one embodiment, before the step of receiving the second data sent by the data provision system, the method further includes:

[0033] receiving a data acquisition request sent by the data supply system, and determining first data having a data quality problem according to the data acquisition request;

[0034] determining a data application system according to the first data and fourth data corresponding to the first data, wherein the fourth data is used to indicate data obtained by processing the first data;

[0035] List information is constructed according to the first data, the fourth data and the data application system, and the list information is fed back to the data supply system.

[0036] In another embodiment, the step of determining a data application system according to the first data and fourth data corresponding to the first data includes:

[0037] Determine the processed data corresponding to the first data and the target sub-data in the first data, the target sub-data is used to forward data to the setting system, and the fourth data includes the target sub-data and the processed data;

[0038] Determine a port for receiving the first data, and determine a system where the port is located, a system for receiving the processed data, and a system for receiving the target sub-data as data application systems;

[0039] In another embodiment, the step of updating the first data according to the second data to obtain the third data includes:

[0040] Generate a repair strategy control table according to the data quality problem corresponding to the first data;

[0041] Sending the repair strategy control table to the audit terminal;

[0042] receiving the audit result of the repair strategy control table by the audit terminal;

[0043] In response to the audit result being passed, the first data is updated according to the repair strategy control table and the second data to obtain third data.

[0044] In another embodiment, the step of sending data update completion information to the data application system includes:

[0045] Determining a data acquisition dependency condition according to the third data;

[0046] Data update completion information is generated according to the data acquisition dependency condition, and the data update completion information is sent to the data supply system.

[0047] In a third aspect, an embodiment of the present application provides a data updating method, which is applied to a data provision system. The data updating method includes:

[0048] Receiving a collaborative work order sent by a data supply system, and determining, in the data supply system according to the collaborative work order, target data associated with first data, where the first data is data in the collaborative work order indicating a data quality problem;

[0049] Receive data update completion information sent by the data warehouse system;

[0050] In response to the data updated by the data update completion information being the first data, sending a data acquisition request to the data warehouse system according to the first data;

[0051] receiving third data fed back by the data warehouse system based on the data acquisition request, and updating the target data according to the third data, wherein the third data is data obtained by the data warehouse system updating the first data based on the second data, and the second data is data obtained by the data supply system repairing data quality problems;

[0052] A second repair verification result is obtained based on the updated target data, and the second repair verification result is sent to the data supply system, so that the data supply system can determine whether the data supply system, the data warehouse system and the data application system have collaboratively completed the data update based on the first repair verification result and the second repair verification result. The first repair verification result is the verification result obtained by the data supply system after repairing the data quality problem.

[0053] In one embodiment, the step of sending a data acquisition request to the data warehouse system according to the first data includes:

[0054] Acquiring data acquisition dependency conditions according to the data update completion information;

[0055] A data acquisition request is generated according to the data acquisition dependency condition and the first data, and the data acquisition request is sent to the data warehouse system.

[0056] In another embodiment, the step of updating the target data according to the third data includes:

[0057] generating a repair strategy control table according to the data quality problem corresponding to the first data in the collaborative work order and the third data;

[0058] Sending the repair strategy control table to the audit terminal;

[0059] receiving the audit result of the repair strategy control table by the audit terminal;

[0060] In response to the audit result being that the audit is passed, the target data is updated according to the third data.

[0061] In another embodiment, the step of sending a data acquisition request to the data warehouse system according to the first data includes:

[0062] Determine, according to the collaborative work order, in fourth data, the affected sub-data, wherein the fourth data is data obtained by processing the first data;

[0063] In response to the affected sub-data matching the target data, a data acquisition request is sent to the data warehouse system according to the first data.

[0064] In another embodiment, the step of determining the affected sub-data, wherein the fourth data is data obtained by processing the first data, comprises:

[0065] In response to the affected sub-data not matching the target data, prompt information is sent to the data supply system, where the prompt information is used to indicate that the data application system is not affected by the first data with data quality problems.

[0066] In another embodiment, the step of updating the target data according to the third data includes:

[0067] Marking the target data, and displaying the marked target data;

[0068] In response to an update operation on the marked target data, the target data is updated according to the third data.

[0069] In a fourth aspect, an embodiment of the present application provides a data provision system, including:

[0070] A first determination module is used to determine, in response to the data supply system detecting a data quality problem, first data affected by the data quality problem and a data application system using the first data, and generate a collaborative work order according to the first data;

[0071] A repair module, used to repair the data quality problem to obtain second data and a first repair verification result corresponding to the second data, and send the collaborative work order to the data application system, and send the second data to the data warehouse system;

[0072] a receiving module, configured to receive a second repair verification result sent by the data application system, wherein the second repair verification result is used to indicate to the data application system a result of repairing the data based on third data obtained from the data warehouse system by the collaborative work order, wherein the third data is data obtained by the data warehouse system updating the first data based on the second data;

[0073] The second determination module is used to determine that the data supply system, the data warehouse system and the data application system collaboratively complete data update in response to the first repair verification result matching the second repair verification result.

[0074] In a fifth aspect, an embodiment of the present application provides a data warehouse system, including:

[0075] A first receiving module is used to receive second data sent by a data supply system, and determine first data corresponding to the second data in the data warehouse system, wherein the first data is data with data quality problems stored in the data warehouse system by the data supply system, and the second data is data obtained by repairing the data quality problems;

[0076] An updating module, configured to update the first data according to the second data to obtain third data, and send data updating completion information to the data application system;

[0077] The second receiving module is used to receive a data acquisition request fed back by the data application system based on the data update completion information, and send the third data to the data application system so that the data application system can perform data update based on the third data.

[0078] In a sixth aspect, an embodiment of the present application provides a data provision system, including:

[0079] A first receiving module is used to receive a collaborative work order sent by a data supply system, and determine target data associated with first data in the data supply system according to the collaborative work order, where the first data is data indicating a data quality problem in the collaborative work order;

[0080] The second receiving module is used to receive the data update completion information sent by the data warehouse system;

[0081] A sending module, configured to send a data acquisition request to the data warehouse system according to the first data in response to the data updated by the data update completion information being the first data;

[0082] a third receiving module, configured to receive third data fed back by the data warehouse system based on the data acquisition request, and update the target data according to the third data, wherein the third data is data obtained by the data warehouse system updating the first data based on the second data, and the second data is data obtained by the data supply system repairing data quality problems;

[0083] An acquisition module is used to obtain a second repair verification result based on the updated target data, and send the second repair verification result to the data supply system, so that the data supply system can determine whether the data supply system, the data warehouse system and the data application system have collaboratively completed the data update based on the first repair verification result and the second repair verification result. The first repair verification result is a verification result obtained by the data supply system after repairing the data quality problem.

[0084] In a seventh aspect, an embodiment of the present application provides a data updating device, comprising: a processor and a memory storing computer program instructions; when the processor executes the computer program instructions, the data updating method as described above is implemented.

[0085] In an eighth aspect, an embodiment of the present application provides a computer-readable storage medium, characterized in that computer program instructions are stored on the computer-readable storage medium, and when the computer program instructions are executed by a processor, the data updating method as described above is implemented.

[0086] In a ninth aspect, an embodiment of the present application provides a computer program product. When instructions in the computer program product are executed by a processor of an electronic device, the electronic device is able to perform the data updating method as described above.

[0087] The data update method and related equipment of the embodiment of the present application, when the data supply system detects a data quality problem, determines the first data affected by the data quality problem and the data application system using the first data, generates a collaborative work order based on the first data, the data supply system repairs the data quality problem to obtain the second data and the first repair verification result corresponding to the second data, then sends the collaborative work order to the data application system, and sends the second data to the data warehouse system, receives the second repair verification result sent by the data application system, and when the first repair verification result matches the second repair verification result, it is determined that the data supply system, the data warehouse system and the data application system have collaboratively completed the data update. In the present application, when the data supply system detects a data quality problem, the data supply system leads the data warehouse system and the data application system to collaboratively repair and update the data, and there is no need for the data warehouse system to lead the repair and update of the data, which reduces the working pressure of the data warehouse system and improves the operating stability of the data warehouse system. BRIEF DESCRIPTION OF THE DRAWINGS

[0088] In order to more clearly illustrate the technical solution of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0089] Figure 1 is an interactive flow chart of the data updating method of the present application;

[0090] Figure 2 It is a flowchart of the first embodiment of the data updating method on the data supply system side of the present application;

[0091] Figure 3 It is a flowchart of the second embodiment of the data updating method on the data supply system side of the present application;

[0092] Figure 4 It is a flowchart of the third embodiment of the data updating method on the data supply system side of the present application;

[0093] Figure 5 It is a flowchart of the first embodiment of the data updating method on the data warehouse system side of the present application;

[0094] Figure 6 It is a flowchart of the second embodiment of the data updating method on the data warehouse system side of the present application;

[0095] Figure 7 It is a flowchart of the third embodiment of the data updating method on the data warehouse system side of the present application;

[0096] Figure 8 It is a flowchart of the first embodiment of the data updating method on the data application system side of the present application;

[0097] Fig. 9 It is a flowchart of the second embodiment of the data updating method on the data application system side of the present application;

[0098] Fig.10 It is a flowchart of the third embodiment of the data updating method on the data application system side of the present application;

[0099] Fig.11 It is a functional module diagram of the data supply system of this application;

[0100] Fig.12 It is a functional module diagram of the data warehouse system of this application;

[0101] Fig.13 It is a functional module diagram of the data application system of this application;

[0102] Fig.14 It is a structural diagram of the data updating device of this application. DETAILED DESCRIPTION

[0103] The features and exemplary embodiments of various aspects of the present application will be described in detail below. In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain the present application, rather than to limit the present application. For those skilled in the art, the present application can be implemented without the need for some of these specific details. The following description of the embodiments is only to provide a better understanding of the present application by illustrating the examples of the present application.

[0104] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "include..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0105] It should be noted that the acquisition, storage, use and processing of data in the embodiments of the present application are in compliance with the relevant provisions of national laws and regulations.

[0106] It should be noted that in the embodiments of the present application, certain software, components, models and other existing solutions in the industry may be mentioned, and they should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present application, but it does not mean that the applicant has or will necessarily use the solution.

[0107] In the era of big data, all transaction data can be analyzed and summarized to extract useful information. In the data chain of analysis, summary and extraction, the system that generates data is the data supply system, the system that analyzes, summarizes and extracts data is the data application system, and the system that stores data is the data warehouse system.

[0108] During the operation of the data supply system, if erroneous data appears, the erroneous data will be stored in the data warehouse system, causing the data application system to use the erroneous data for application.

[0109] In the exemplary technology, the data warehouse system generally sends inspection requests to the data supply system in a periodic polling manner, so that the data supply system finds erroneous data, and the data warehouse system then directs the data supply system and the data application system to modify and update the erroneous data.

[0110] The inventor of the present application discovered that the data warehouse system is connected to multiple data supply systems and data application systems. The data warehouse system dominates the data supply systems and data application systems. Modification and updating of erroneous data will cause the workload of the data warehouse system to be too heavy, making the data warehouse system unstable. In other words, data updates lead to poor operating stability of the data warehouse system.

[0111] The inventor of the present application therefore came up with the idea that when the data supply system detects data quality problems, the data supply system will lead the data warehouse system and the data application system to collaboratively repair and update the data. There is no need for the data warehouse system to lead the repair and update of the data, which reduces the working pressure of the data warehouse system and improves the operating stability of the data warehouse system.

[0112] Reference Figure 1 , Figure 1 This is an exchange flow chart of the data updating method of this application.

[0113] Reference Figure 1 ,101. The data supply system detects data quality issues;

[0114] 102. Determine first data affected by the data quality problem and a data application system using the first data;

[0115] 103. Generate a collaborative work order based on the first data;

[0116] 104. Repair the data quality problem to obtain second data and a first repair verification result corresponding to the second data;

[0117] 105. Send the collaborative work order to the data application system;

[0118] 106. Send the second data to the data warehouse system;

[0119] 107. The data warehouse system determines data corresponding to the second data, where the data is the first data with data quality problems sent by the data supply system;

[0120] 108. The data warehouse system updates the first data based on the second data to obtain third data;

[0121] 109. The data warehouse system sends data update completion information to the data application system;

[0122] 110. The data application system sends a data acquisition request to the data warehouse system based on the data update completion information;

[0123] 111. The data warehouse system sends the third data to the data application system based on the data acquisition request;

[0124] 112. The data application system determines target data associated with the first data based on the collaborative work order;

[0125] 113. The data application system updates the target data based on the third data, and obtains a second repair verification result based on the updated target data;

[0126] 114. The data application system sends a second repair verification result to the data supply system;

[0127] 115. The data supply system matches the first repair verification result with the second repair verification result. If the first repair verification result matches the second repair verification result, it is determined that the data supply system, the data warehouse system, and the data application system collaborate to complete the data repair update.

[0128] The following combination Figure 1 , the data updating method of this application is described in detail.

[0129] Reference Figure 2 , Figure 2 FIG. 1 is a flow chart of a first embodiment of a data updating method on a data supply system side of the present application. The data updating method includes:

[0130] Step S201, in response to a data supply system detecting a data quality problem, determining first data affected by the data quality problem and a data application system using the first data, and generating a collaborative work order based on the first data.

[0131] In this embodiment, the execution subject is a data supply system, which is a system that produces data and provides data to a data warehouse system. For ease of description, the upstream system is used below to refer to the data supply system.

[0132] The upstream system will periodically or in real time detect whether it has data quality problems. Data quality problems refer to abnormal parameter ranges in the data, malfunctions in the data collection components, and the collection of erroneous data. When a data quality problem occurs in the upstream system, the upstream system determines the first data affected by the data quality. Exemplarily, the data quality problem is caused by the failure of component A, and thus the data collected by component A are all the first data affected by the data quality problem.

[0133] After determining the first data, the upstream system determines a data application system that uses the first data. Using the first data includes directly using the first data and indirectly using the first data. Directly using the first data, for example, directly using the first data for summarization, processing, extraction, etc., and indirectly using the first data, for example, using processed data of the first data for summarization, processing, extraction, etc.

[0134] Specifically, after the upstream system sends the first data to the data warehouse system, the data warehouse system stores the first data and processes the first data to obtain processed data. After the data application system obtains the first data or processed data from the data warehouse system, the data warehouse system records the identifier of the data application system, and the recorded identifier is the record information. The upstream system obtains the record information from the data warehouse system to determine the data application system that uses the first data.

[0135] After determining the first data, the upstream system generates a collaborative work order based on the first data. The collaborative work order is, for example, "the first data has a quality problem, and data repair is required for data directly using the first data and data indirectly using the first data."

[0136] Step S202, repair the data quality problem to obtain second data and a first repair verification result corresponding to the second data, send the collaborative work order to the data application system, and send the second data to the data warehouse system.

[0137] The upstream system repairs the data quality problem to obtain the second data. For example, if the data quality problem is a component failure, the component is repaired, and the data collected by the component after the failure is repaired is the second data; if the data quality problem is an abnormal value in the first data, the value is corrected to obtain the second data.

[0138] After completing the repair of the data quality problem, repair verification is required. For example, if a component fails, after repairing the failed component, test whether the component is operating normally to obtain a repair verification result, which is defined as the second repair verification result. If an abnormal range of values ​​appears in the first data, correct the value and then test again whether the corrected value is correct to obtain a repair verification result.

[0139] After obtaining the collaborative work order and the second data, the upstream system sends the second data to the data warehouse system and sends the collaborative work order to the data application system.

[0140] After receiving the second data sent by the upstream system, the data warehouse system determines the first data corresponding to the second data from the data stored in the data warehouse system itself. The first data is the data with data quality problems stored in the data warehouse system by the upstream system. The second data is the data obtained by repairing the data quality problems. The data warehouse system updates the first data according to the second data to obtain the third data, and then sends the data update completion information to the data application system.

[0141] The data application system receives the collaborative work order sent by the data supply system, and determines the target data associated with the first data in the data supply system based on the collaborative work order. The target data is the first data or data processed from the first data, and the data warehouse system processes the first data to obtain the target data. After the data application system receives the data update completion information sent by the data warehouse system, it will verify that the data updated by the data update completion information is the first data, and the data supply system will send a data acquisition request to the data warehouse system to request the data warehouse system to send the third data.

[0142] The data application system receives the third data sent by the data warehouse system, and updates the target data through the third data. Exemplarily, the target data can be directly replaced by the third data.

[0143] After updating the target data, the data application system obtains a second repair verification result based on the updated target data. Exemplarily, after updating the target data, the update completion information is output, so that the maintenance personnel of the data supply system can verify and detect the updated target data to obtain the second repair verification result, and the second repair verification result is, for example, passed the repair or failed the repair. The data application system sends the second repair verification result to the upstream system.

[0144] Step S203, receiving a second repair verification result sent by the data application system, wherein the second repair verification result is used to indicate the data application system, based on the third data obtained from the data warehouse system by the collaborative work order, the result of repairing the data, and the third data is the data obtained by the data warehouse system by updating the first data based on the second data.

[0145] The upstream system receives the second repair verification result sent by the data application system. It can be understood that the second repair verification result is the result obtained by the data application system repairing the data based on the third data obtained from the data warehouse system by the collaborative work order, and the third data is the data obtained by the data warehouse system updating the first data based on the second data.

[0146] Step S204, in response to the first repair verification result matching the second repair verification result, determining that the data supply system, the data warehouse system, and the data application system collaborate to complete the data update.

[0147] The upstream system matches its own first repair verification result with the received second repair verification result. If the first repair verification result matches the second repair verification result, it can be determined that the data supply system, the data warehouse system and the data application system have collaboratively completed the data update.

[0148] Exemplarily, when both the first repair verification result and the second repair verification result are successful repairs, the first repair verification result matches the second repair verification result.

[0149] When there is a repair failure result in the first repair verification result and the second repair verification result, the first repair verification result does not match the second repair verification result, and a data acquisition instruction is sent to the data application system. The data application system obtains a repair record of the repair data based on the data acquisition quality. The repair record is defined as a first repair record. The data application system sends the first repair record to the upstream system, and the upstream system obtains second repair record information obtained by repairing the data quality problem. The upstream system generates repair report information based on the first repair record and the second repair record, and sends the repair report information to the terminal associated with the repair personnel, thereby notifying manual access to repair and check the upstream system and the data application system.

[0150] In this embodiment, when the data supply system detects a data quality problem, it determines the first data affected by the data quality problem and the data application system using the first data, generates a collaborative work order based on the first data, and the data supply system repairs the data quality problem to obtain the second data and the first repair verification result corresponding to the second data, then sends the collaborative work order to the data application system, and sends the second data to the data warehouse system, receives the second repair verification result sent by the data application system, and when the first repair verification result matches the second repair verification result, it is determined that the data supply system, the data warehouse system, and the data application system have collaboratively completed the data update. In this embodiment, when the data supply system detects a data quality problem, the data supply system leads the data warehouse system and the data application system to collaboratively repair and update the data, and there is no need for the data warehouse system to lead the repair and update of the data, which reduces the work pressure of the data warehouse system and improves the operational stability of the data warehouse system.

[0151] Reference Figure 3 , Figure 3 This is a flow chart of the second embodiment of the data updating method of the present application. Based on the first embodiment, step S203 includes:

[0152] Step S301: Generate a data acquisition request according to the data quality problem, and send the data acquisition request to the data warehouse system.

[0153] In this embodiment, the upstream system determines a data application system that uses the first data from the data warehouse system.

[0154] Specifically, the device generates a data acquisition request based on the data quality problem, and the data acquisition request is, for example: obtaining a list of data application systems that use the first data.

[0155] Step S302: receiving list information sent by the data warehouse system based on the data sending request, where the list information includes systems using the first data.

[0156] Step S303: determining a data application system that uses the first data according to the list information.

[0157] After receiving the data acquisition request, the data warehouse system can determine the first data with data quality problems by parsing the data acquisition request. The device determines the list of sources, models and customization areas affected by the first data. The source refers to the data source, that is, the affected source refers to the affected data source. The model refers to the data processed for the first data. The customization area refers to the customized sub-data in the first data. The customized sub-data can forward data. The system where the data source corresponding to the source is located, the system using the data of the model, and the system using the data of the customization area are the data application systems using the first data. The identification information of these data application systems constitutes the list information. The data warehouse system sends the list information to the upstream system. After the upstream system receives the list information, it can determine the data application system using the first data based on the identification on the list information.

[0158] Furthermore, when determining the data application system using the first data, the data warehouse system constructs list information together with the data corresponding to the source, model, and customization area and the identifier of the data application system using the first data. The data corresponding to the source, model, and customization area are defined as fourth data, that is, the fourth data is data obtained by processing the first data. The data warehouse system generates list information based on the first data and the fourth data, and then sends the list information to the upstream system. The upstream system determines the fourth data associated with the first data in the data warehouse system based on the list information, thereby generating a collaborative work order based on the fourth data and the first data.

[0159] In this embodiment, the upstream system generates a data acquisition request based on the data quality problem, and then sends the data acquisition request to the data warehouse system, thereby quickly determining the data application system using the first data from the list information fed back by the data warehouse system.

[0160] Reference Figure 4 , Figure 4 This is a flowchart of a third embodiment of the data updating method of the present application. Based on the first or second embodiment, step S202 includes:

[0161] Step S401, generating a repair strategy control table according to data quality issues.

[0162] Step S402: Send the repair strategy control table to the audit terminal.

[0163] Step S403: receiving the audit result of the audit terminal on the repair strategy control table.

[0164] Step S404, in response to the audit result being audit passed, repairing the data quality problem according to the repair strategy control table to obtain second data.

[0165] In this embodiment, before the upstream system repairs the data quality problem, it needs to be reviewed by the data center, and the terminal corresponding to the data center is the review terminal.

[0166] The upstream system generates a repair strategy control table based on data quality issues. The repair strategy control table refers to the strategy containing the repair data in the upstream system. The upstream system sends the repair strategy control table to the audit terminal. The audit terminal audits the repair strategy in the repair strategy control table to obtain the audit result, and the audit terminal sends the audit result to the upstream system.

[0167] After the upstream system receives the audit result, if the audit result is passed, the data quality problem is repaired based on the repair strategy in the repair strategy control table to obtain the second data.

[0168] In this embodiment, the upstream system generates a repair strategy control table based on the data quality problem, and sends the repair strategy control table to the audit terminal, so as to repair the data quality problem based on the audit result of the audit terminal, that is, the repair strategy based on the successful audit ensures that the data quality problem can be repaired.

[0169] Reference Figure 5 , Figure 5 This is a flow chart of the first embodiment of the data updating method on the data warehouse system side of the present application. The data updating method includes:

[0170] Step S501, receiving second data sent by the data supply system, and determining first data corresponding to the second data in the data warehouse system, the first data is data with data quality problems stored in the data warehouse system by the data supply system, and the second data is data obtained by repairing the data quality problems.

[0171] In this embodiment, the execution subject is a data warehouse system.

[0172] The data supply system will periodically or in real time detect whether it has data quality problems. Data quality problems refer to abnormal parameter ranges in the data, malfunctions in the data collection components, and the collection of erroneous data. When a data quality problem occurs in the data supply system, the data supply system determines the first data affected by the data quality. Exemplarily, the data quality problem is caused by the failure of component A, and thus the data collected by component A are all the first data affected by the data quality problem.

[0173] After determining the first data, the data supply system determines a data application system that uses the first data. Using the first data includes directly using the first data and indirectly using the first data. Directly using the first data, for example, directly using the first data for summarization, processing, extraction, etc., and indirectly using the first data, for example, using processed data of the first data for summarization, processing, extraction, etc.

[0174] Specifically, after the data supply system sends the first data to the data warehouse system, the data warehouse system stores the first data and processes the first data to obtain processed data. After the data application system obtains the first data or processed data from the data warehouse system, the data warehouse system records the identifier of the data application system, and the recorded identifier is the record information. The data supply system obtains the record information from the data warehouse system to determine the data application system that uses the first data.

[0175] After determining the first data, the data supply system generates a collaborative work order based on the first data. The collaborative work order is, for example, "the first data has a quality problem, and data repair is required for data directly using the first data and indirectly using the first data."

[0176] The data supply system repairs the data quality problem to obtain the second data. Exemplarily, if the data quality problem is a component failure, the component is repaired, and the data collected by the component after the failure is repaired is the second data; if the data quality problem is an abnormal value in the first data, the value is corrected to obtain the second data.

[0177] After completing the repair of the data quality problem, repair verification is required. For example, if a component fails, after repairing the failed component, test whether the component is operating normally to obtain a repair verification result, which is defined as the second repair verification result. If an abnormal range of values ​​appears in the first data, correct the value and then test again whether the corrected value is correct to obtain a repair verification result.

[0178] After obtaining the collaborative work order and the second data, the data supply system sends the second data to the data warehouse system and sends the collaborative work order to the data application system.

[0179] Step S502: Update the first data according to the second data to obtain third data, and send data update completion information to the data application system.

[0180] After receiving the second data sent by the data supply system, the data warehouse system determines the first data corresponding to the second data from the data stored in the data warehouse system itself. The first data is the data with data quality problems stored in the data warehouse system by the data supply system. The second data is the data obtained by repairing the data quality problems. The data warehouse system updates the first data according to the second data to obtain the third data, and then sends the data update completion information to the data application system.

[0181] Step S503: receiving a data acquisition request fed back by the data application system based on the data update completion information, and sending the third data to the data application system, so that the data application system can perform data update based on the third data.

[0182] The data application system receives the collaborative work order sent by the data supply system, and determines the target data associated with the first data in the data supply system based on the collaborative work order. The target data is the first data or data processed from the first data, and the data warehouse system processes the first data to obtain the target data. After the data application system receives the data update completion information sent by the data warehouse system, it will verify that the data updated by the data update completion information is the first data, and the data supply system will send a data acquisition request to the data warehouse system to request the data warehouse system to send the third data.

[0183] The data application system receives the third data sent by the data warehouse system, and updates the target data through the third data. Exemplarily, the target data can be directly replaced by the third data.

[0184] After updating the target data, the data application system obtains a second repair verification result based on the updated target data. Exemplarily, after updating the target data, update completion information is output, so that the maintenance personnel of the data supply system can verify and detect the updated target data to obtain a second repair verification result, such as passing the repair or failing the repair. The data application system sends the second repair verification result to the data supply system.

[0185] The data supply system receives the second repair verification result sent by the data application system. It can be understood that the second repair verification result is the result obtained by the data application system repairing the data based on the third data obtained from the data warehouse system by the collaborative work order, and the third data is the data obtained by the data warehouse system updating the first data based on the second data.

[0186] The data supply system matches its own first repair verification result with the received second repair verification result. If the first repair verification result matches the second repair verification result, it can be determined that the data supply system, the data warehouse system and the data application system have collaboratively completed the data update.

[0187] Exemplarily, when both the first repair verification result and the second repair verification result are successful repairs, the first repair verification result matches the second repair verification result.

[0188] When there is a repair failure result in the first repair verification result and the second repair verification result, the first repair verification result does not match the second repair verification result, and a data acquisition instruction is sent to the data application system. The data application system obtains a repair record of the repair data based on the data acquisition quality. The repair record is defined as a first repair record. The data application system sends the first repair record to the data supply system. The data supply system obtains second repair record information obtained by repairing the data quality problem. The data supply system generates repair report information based on the first repair record and the second repair record, and sends the repair report information to the terminal associated with the repair personnel, thereby notifying manual access to repair and check the data supply system and the data application system.

[0189] In this embodiment, when the data supply system detects data quality problems, the data supply system leads the data warehouse system and the data application system to collaboratively repair and update the data. There is no need for the data warehouse system to lead the repair and update of the data, which reduces the workload of the data warehouse system and improves the operating stability of the data warehouse system.

[0190] Reference Figure 6 , Figure 6 This is a flow chart of the second embodiment of the data updating method on the data warehouse system side of the present application, based on Figure 5 In the embodiment shown, before step S501, the following steps are further included:

[0191] Step S601: receiving a data acquisition request sent by a data supply system, and determining first data with data quality problems according to the data acquisition request.

[0192] Step S602: determining a data application system according to the first data and fourth data corresponding to the first data, where the fourth data is used to indicate data obtained by processing the first data.

[0193] Step S603: constructing list information according to the first data, the fourth data and the data application system, and feeding back the list information to the data supply system.

[0194] In this embodiment, the data supply system determines a data application system that uses the first data from the data warehouse system.

[0195] Specifically, the device generates a data acquisition request based on the data quality problem, and the data acquisition request is, for example: obtaining a list of data application systems that use the first data.

[0196] After receiving the data acquisition request, the data warehouse system can determine the first data with data quality problems by parsing the data acquisition request. The device determines the list of sources, models and customization areas affected by the first data. The source refers to the data source, that is, the affected source refers to the affected data source. The model refers to the data processed by the first data. The customization area refers to the customized sub-data in the first data. The customized sub-data can forward data. The system where the data source corresponding to the source is located, the system using the data of the model, and the system using the data of the customization area are the data application systems using the first data. These data are the first data and the fourth data, so that the identification information of the data application system is determined based on the first data and the fourth data, and the first data and the fourth data constitute the list information. The data warehouse system sends the list information to the data supply system. After receiving the list information, the data supply system can determine the data application system using the first data based on the identification on the list information.

[0197] Further, the data warehouse system determines the processing data corresponding to the first data and the target sub-data in the first data, the processing data is the model data, the target sub-data is the customization area data, that is, the target sub-data is used to forward data to the setting system, and the fourth data includes the target sub-data and the processing data. The data warehouse system determines the port of the first data, and determines the system where the port is located, the system receiving the processing data, and the system receiving the target sub-data as the data application system.

[0198] In this embodiment, the data warehouse system sends list information to the data supply system based on the data acquisition request sent by the data supply system, so that the data supply system quickly determines the data application system affected by the first data based on the list information.

[0199] Reference Figure 7 , Figure 7 This is a flow chart of the third embodiment of the data update method on the data warehouse system side of the present application, based on Figure 5 or Figure 6 In the illustrated embodiment, step S502 includes:

[0200] Step S701: Generate a repair strategy control table according to the data quality problem corresponding to the first data.

[0201] Step S702: Send the repair strategy control table to the audit terminal.

[0202] Step S703: receiving the audit result of the audit terminal on the repair strategy control table.

[0203] Step S704, in response to the audit result being passed, the first data is updated according to the repair strategy control table and the second data to obtain the third data.

[0204] In this embodiment, when the data warehouse system is repairing data, it needs to be audited by the data center, and the terminal corresponding to the data center is the audit terminal.

[0205] The data warehouse system generates a repair strategy control table based on data quality issues. The repair strategy control table refers to the strategy containing the data warehouse system repair data. The data warehouse system sends the repair strategy control table to the audit terminal. The audit terminal audits the repair strategy in the repair strategy control table to obtain the audit result, and the audit terminal sends the audit result to the data warehouse system.

[0206] After the data warehouse system receives the audit result, if the audit result is passed, the first data is repaired based on the second data based on the repair strategy in the repair strategy control table to obtain the third data. It should be noted that the data warehouse system first replaces the first data with the second data. In addition, the replaced data needs to be reprocessed and processed to obtain new model data and customized area data.

[0207] In this embodiment, the data warehouse system generates a repair strategy control table based on data quality issues, and sends the repair strategy control table to the audit terminal, thereby repairing the first data based on the audit results of the audit terminal, that is, ensuring that the first data can be repaired based on the repair strategy that succeeded the audit.

[0208] In one embodiment, the step of sending data update completion information to the data application system includes:

[0209] determining a data acquisition dependency condition according to third data;

[0210] Generate data update completion information according to the data acquisition dependency conditions and send the data update completion information to the data supply system.

[0211] In this embodiment, the data supply system relies on the data warehouse system's paste source, model and customization area data. The data warehouse system needs to complete data repair before the data supply system can obtain new paste source, model and customization area data from the data warehouse system.

[0212] In this regard, the data warehouse system determines the data acquisition dependency condition based on the third data, generates data update completion information based on the data acquisition dependency condition, and the parallel data supply system sends the data update completion information. Exemplarily, the third data is the data after the first data is updated based on the second data, and the data acquisition dependency condition includes the identifiers corresponding to the model, the paste source, and the customization area data in the third data. The data supply system can obtain the identifier of the data it needs to obtain based on the identifier in the data acquisition dependency condition in the data update completion information, so as to generate a data acquisition request and obtain the required data from the data warehouse system.

[0213] In this embodiment, the data warehouse system updates the data acquisition dependency conditions of the data supply system based on the third data, generates data update completion information based on the data acquisition dependency conditions, and then sends the data update completion information to the data application system, so that the data application system obtains data from the data warehouse system in a timely manner.

[0214] Reference Figure 8 , Figure 8 This is a flow chart of the first embodiment of the data updating method on the data application system side of the present application. The data updating method includes:

[0215] Step S801: Receive a collaborative work order sent by a data supply system, and determine target data associated with first data in the data supply system according to the collaborative work order, where the first data is data indicating a data quality problem in the collaborative work order.

[0216] Step S802: Receive data update completion information sent by the data warehouse system.

[0217] Step S803: In response to the data update completion information indicating that the data updated is the first data, a data acquisition request is sent to the data warehouse system according to the first data.

[0218] Step S804, receiving the third data fed back by the data warehouse system based on the data acquisition request, and updating the target data according to the third data, the third data is the data obtained by the data warehouse system updating the first data based on the second data, and the second data is the data obtained by the data supply system repairing data quality problems.

[0219] Step S805: obtain a second repair verification result based on the updated target data, and send the second repair verification result to the data supply system, so that the data supply system can determine whether the data supply system, the data warehouse system and the data application system have collaboratively completed the data update based on the first repair verification result and the second repair verification result. The first repair verification result is the verification result obtained by the data supply system after repairing data quality problems.

[0220] In this embodiment, the execution subject is the data application system. The data supply system will periodically or in real time detect whether there is a data quality problem in itself. Data quality problems refer to abnormal parameter ranges in the data, failure of a component that collects data resulting in the collection of erroneous data, etc. When a data quality problem occurs in the data supply system, the data supply system determines the first data affected by the data quality. Exemplarily, the data quality problem is caused by the failure of component A, and thus the data collected by component A are all the first data affected by the data quality problem.

[0221] After determining the first data, the data supply system determines a data application system that uses the first data. Using the first data includes directly using the first data and indirectly using the first data. Directly using the first data, for example, directly using the first data for summarization, processing, extraction, etc., and indirectly using the first data, for example, using processed data of the first data for summarization, processing, extraction, etc.

[0222] Specifically, after the data supply system sends the first data to the data warehouse system, the data warehouse system stores the first data and processes the first data to obtain processed data. After the data application system obtains the first data or processed data from the data warehouse system, the data warehouse system records the identifier of the data application system, and the recorded identifier is the record information. The data supply system obtains the record information from the data warehouse system to determine the data application system that uses the first data.

[0223] After determining the first data, the data supply system generates a collaborative work order based on the first data. The collaborative work order is, for example, "the first data has a quality problem, and data repair is required for data directly using the first data and indirectly using the first data."

[0224] The data supply system repairs the data quality problem to obtain the second data. Exemplarily, if the data quality problem is a component failure, the component is repaired, and the data collected by the component after the failure is repaired is the second data; if the data quality problem is an abnormal value in the first data, the value is corrected to obtain the second data.

[0225] After completing the repair of the data quality problem, repair verification is required. For example, if a component fails, after repairing the failed component, test whether the component is operating normally to obtain a repair verification result, which is defined as the second repair verification result. If an abnormal range of values ​​appears in the first data, correct the value and then test again whether the corrected value is correct to obtain a repair verification result.

[0226] After obtaining the collaborative work order and the second data, the data supply system sends the second data to the data warehouse system and sends the collaborative work order to the data application system.

[0227] After receiving the second data sent by the data supply system, the data warehouse system determines the first data corresponding to the second data from the data stored in the data warehouse system itself. The first data is the data with data quality problems stored in the data warehouse system by the data supply system. The second data is the data obtained by repairing the data quality problems. The data warehouse system updates the first data according to the second data to obtain the third data, and then sends the data update completion information to the data application system.

[0228] The data application system receives the collaborative work order sent by the data supply system, and determines the target data associated with the first data in the data supply system based on the collaborative work order. The target data is the first data or data processed from the first data, and the data warehouse system processes the first data to obtain the target data. After the data application system receives the data update completion information sent by the data warehouse system, it will verify that the data updated by the data update completion information is the first data, and the data supply system will send a data acquisition request to the data warehouse system to request the data warehouse system to send the third data.

[0229] The data application system receives the third data sent by the data warehouse system, and updates the target data through the third data. Exemplarily, the target data can be directly replaced by the third data.

[0230] After updating the target data, the data application system obtains a second repair verification result based on the updated target data. Exemplarily, after updating the target data, update completion information is output, so that the maintenance personnel of the data supply system can verify and detect the updated target data to obtain a second repair verification result, such as passing the repair or failing the repair. The data application system sends the second repair verification result to the data supply system.

[0231] The data supply system receives the second repair verification result sent by the data application system. It can be understood that the second repair verification result is the result obtained by the data application system repairing the data based on the third data obtained from the data warehouse system by the collaborative work order, and the third data is the data obtained by the data warehouse system updating the first data based on the second data.

[0232] The data supply system matches its own first repair verification result with the received second repair verification result. If the first repair verification result matches the second repair verification result, it can be determined that the data supply system, the data warehouse system and the data application system have collaboratively completed the data update.

[0233] Exemplarily, when both the first repair verification result and the second repair verification result are successful repairs, the first repair verification result matches the second repair verification result.

[0234] When there is a repair failure result in the first repair verification result and the second repair verification result, the first repair verification result does not match the second repair verification result, and a data acquisition instruction is sent to the data application system. The data application system obtains a repair record of the repair data based on the data acquisition quality. The repair record is defined as a first repair record. The data application system sends the first repair record to the data supply system. The data supply system obtains second repair record information obtained by repairing the data quality problem. The data supply system generates repair report information based on the first repair record and the second repair record, and sends the repair report information to the terminal associated with the repair personnel, thereby notifying manual access to repair and check the data supply system and the data application system.

[0235] In this embodiment, when the data supply system detects data quality problems, the data supply system leads the data warehouse system and the data application system to collaboratively repair and update the data. There is no need for the data warehouse system to lead the repair and update of the data, which reduces the workload of the data warehouse system and improves the operating stability of the data warehouse system.

[0236] In one embodiment, the step of sending a data acquisition request to a data warehouse system according to the first data includes:

[0237] Complete the information acquisition based on data update to obtain data acquisition dependency conditions;

[0238] A data acquisition request is generated according to the data acquisition dependency condition and the first data, and the data acquisition request is sent to the data warehouse system.

[0239] In this embodiment, the data supply system relies on the data warehouse system's paste source, model and customization area data. The data warehouse system needs to complete data repair before the data supply system can obtain new paste source, model and customization area data from the data warehouse system.

[0240] In this regard, the data warehouse system determines the data acquisition dependency condition based on the third data, generates data update completion information based on the data acquisition dependency condition, and the parallel data supply system sends the data update completion information. Exemplarily, the third data is the data after the first data is updated based on the second data, and the data acquisition dependency condition includes the identifiers corresponding to the model, the paste source, and the customization area data in the third data. The data supply system can obtain the identifier of the data it needs to obtain based on the identifier in the data acquisition dependency condition in the data update completion information, so as to generate a data acquisition request and obtain the required data from the data warehouse system.

[0241] Reference Fig. 9 , Fig. 9 This is a flow chart of the second embodiment of the data updating method on the data application system side of the present application, step S804 includes:

[0242] Step S901: Generate a repair strategy control table according to the data quality problem corresponding to the first data in the collaborative work order and the third data.

[0243] Step S902: Send the repair strategy control table to the audit terminal.

[0244] Step S903: receiving the audit result of the audit terminal on the repair strategy control table.

[0245] Step S904: in response to the audit result being approved, the target data is updated according to the third data.

[0246] In this embodiment, when the data application system is repairing data, it needs to be audited by the data center, and the terminal corresponding to the data center is the audit terminal.

[0247] The data application system generates a repair strategy control table based on the data quality problem and the third data. The repair strategy control table refers to the strategy containing the data application system repair data. The data application system sends the repair strategy control table to the audit terminal. The audit terminal audits the repair strategy in the repair strategy control table to obtain the audit result, and the audit terminal sends the audit result to the data application system.

[0248] After the data application system receives the audit result, if the audit result is passed, the target data is repaired based on the repair strategy in the repair strategy control table and based on the third data.

[0249] It should be noted that the data supply system, data warehouse system and data application system send their respective repair strategy control tables to the audit terminal. If the audit terminal approves each repair strategy control table, the data supply system, data warehouse system and data application system can perform data repair.

[0250] In this embodiment, the data application system generates a repair strategy control table based on data quality issues, and sends the repair strategy control table to the audit terminal, thereby repairing the target data based on the audit results of the audit terminal, that is, ensuring that the target data can be repaired based on the repair strategy that succeeded the audit.

[0251] Reference Fig.10 , Fig.10 This is a flow chart of the third embodiment of the data updating method on the data application system side of the present application, step S803 includes:

[0252] Step S1001: Determine, according to the collaborative work order, the affected sub-data in the fourth data, where the fourth data is data obtained by processing the first data.

[0253] In this embodiment, the data application system needs to determine whether its own data is actually affected by the first data.

[0254] Exemplarily, the data application system determines the affected sub-data in the fourth data corresponding to the first data based on the data quality problem. Exemplarily, the collaborative work order includes each sub-data in the fourth data, and the data application system obtains the identifier of each sub-data in the fourth data, and each sub-data is the affected sub-data.

[0255] Step S1002 : in response to the affected sub-data matching the target data, sending a data acquisition request to the data warehouse system according to the first data.

[0256] After obtaining the identifier of each sub-data, the data application system determines whether the affected sub-data matches the target data. If the identifier of the target data is the same as the identifier of the sub-data, it can be determined that the data application system uses the affected sub-data, and thus data update is required. The data application system sends a data acquisition request to the data warehouse system based on the first data item.

[0257] When the identifier of the target data is different from the identifiers of each sub-data, it can be determined that the data application system does not use the affected sub-data, that is, the affected sub-data does not match the target data, and a prompt message is sent to the data supply system. The prompt message is used to indicate that the data application system is not affected by the first data with data quality problems.

[0258] In this embodiment, the data application system verifies whether it is affected by the first data with data quality problems, so as to avoid wasting its own resources.

[0259] In one embodiment, the step of updating the target data according to the third data includes:

[0260] Mark the target data and display the marked target data;

[0261] In response to an update operation on the marked target data, the target data is updated according to the third data.

[0262] In this embodiment, when the data warehouse system sends the data update completion information, the data application system marks the target data and displays the marked target data. The marked target data is used to prompt the dependent condition update, and the data application system can update the data. If an update operation for the marked target data is detected, that is, the operation and maintenance personnel can perform an update operation on the target data, the data application system updates the target data based on the third data.

[0263] In this embodiment, the target data is marked to prompt the operation and maintenance personnel to update the data in the data application system in a timely manner.

[0264] See also Fig.11 The data provision system 1100 provided in the embodiment of the present application includes:

[0265] A first determination module 1110 is configured to, in response to a data supply system detecting a data quality problem, determine first data affected by the data quality problem and a data application system using the first data, and generate a collaborative work order according to the first data;

[0266] The repair module 1120 is used to repair the data quality problem to obtain the second data and the first repair verification result corresponding to the second data, and send the collaborative work order to the data application system, and send the second data to the data warehouse system;

[0267] The receiving module 1130 is used to receive a second repair verification result sent by the data application system, wherein the second repair verification result is used to indicate the data application system, based on the third data obtained from the data warehouse system by the collaborative work order, the result of repairing the data, the third data is the data obtained by the data warehouse system updating the first data based on the second data;

[0268] The second determination module 1140 is used to determine that the data supply system, the data warehouse system and the data application system collaboratively complete the data update in response to the first repair verification result matching the second repair verification result.

[0269] In one embodiment, the data provision system 1100 is specifically used for:

[0270] Generate a data acquisition request based on the data quality issue and send the data acquisition request to the data warehouse system;

[0271] receiving list information sent by the data warehouse system based on a data sending request, wherein the list information includes systems using the first data;

[0272] A data application system using the first data is determined according to the list information.

[0273] In one embodiment, the data provision system 1100 is specifically used for:

[0274] According to the list information, fourth data associated with the first data is determined in the data warehouse system, where the fourth data is data obtained by processing the first data;

[0275] A collaborative work order is generated according to the first data and the fourth data.

[0276] In one embodiment, the data provision system 1100 is specifically used for:

[0277] Generate a repair strategy control table based on data quality issues;

[0278] Send the repair strategy control table to the audit terminal;

[0279] Receive the audit result of the audit terminal on the repair strategy control table;

[0280] In response to the audit result being that the audit is passed, the data quality problem is repaired according to the repair strategy control table to obtain the second data.

[0281] In one embodiment, the data provision system 1100 is specifically used for:

[0282] In response to the first repair verification result not matching the second repair verification result, sending a data acquisition instruction to the data application system;

[0283] Receiving first repair record information fed back by the data application system based on the data acquisition instruction, and obtaining second repair record information obtained by the data supply system after repairing the data quality problem;

[0284] Repair report information is generated according to the first repair record information and the second repair record information, and the repair report information is sent to a terminal associated with the repair person.

[0285] See also Fig.12 The data warehouse system 1200 provided in the embodiment of the present application includes:

[0286] The first receiving module 1210 is used to receive second data sent by the data supply system, and determine first data corresponding to the second data in the data warehouse system, where the first data is data with data quality problems stored in the data warehouse system by the data supply system, and the second data is data obtained by repairing the data quality problems;

[0287] An updating module 1220, configured to update the first data according to the second data to obtain third data, and send data updating completion information to the data application system;

[0288] The second receiving module 1230 is used to receive a data acquisition request fed back by the data application system based on the data update completion information, and send the third data to the data application system so that the data application system can perform data update based on the third data.

[0289] In one embodiment, the data warehouse system 1200 is specifically used for:

[0290] receiving a data acquisition request sent by a data supply system, and determining first data having a data quality problem according to the data acquisition request;

[0291] determining a data application system according to the first data and fourth data corresponding to the first data, the fourth data being used to indicate data obtained by processing the first data;

[0292] List information is constructed according to the first data, the fourth data and the data application system, and the list information is fed back to the data supply system.

[0293] In one embodiment, the data warehouse system 1200 is specifically used for:

[0294] Determine the processed data corresponding to the first data and the target sub-data in the first data, the target sub-data is used to forward data to the setting system, and the fourth data includes the target sub-data and the processed data;

[0295] Determine a port for receiving the first data, and determine the system where the port is located, the system for receiving the processed data, and the system for receiving the target sub-data as data application systems;

[0296] In one embodiment, the data warehouse system 1200 is specifically used for:

[0297] Generate a repair strategy control table according to the data quality problem corresponding to the first data;

[0298] Send the repair strategy control table to the audit terminal;

[0299] Receive the audit result of the audit terminal on the repair strategy control table;

[0300] In response to the audit result being passed, the first data is updated according to the repair strategy control table and the second data to obtain the third data.

[0301] In one embodiment, the data warehouse system 1200 is specifically used for:

[0302] determining a data acquisition dependency condition according to third data;

[0303] Generate data update completion information according to the data acquisition dependency conditions and send the data update completion information to the data supply system.

[0304] See also Fig.13 The data application system 1300 provided in the embodiment of the present application includes:

[0305] The first receiving module 1310 is used to receive a collaborative work order sent by the data supply system, and determine target data associated with the first data in the data supply system according to the collaborative work order, where the first data is data indicating a data quality problem in the collaborative work order;

[0306] The second receiving module 1320 is used to receive data update completion information sent by the data warehouse system;

[0307] A sending module 1330, configured to send a data acquisition request to a data warehouse system according to the first data in response to the data updated by the data update completion information being the first data;

[0308] The third receiving module 1340 is used to receive the third data fed back by the data warehouse system based on the data acquisition request, and update the target data according to the third data, wherein the third data is data obtained by the data warehouse system updating the first data based on the second data, and the second data is data obtained by the data supply system repairing data quality problems;

[0309] Acquisition module 1350 is used to obtain a second repair verification result based on the updated target data, and send the second repair verification result to the data supply system, so that the data supply system can determine whether the data supply system, the data warehouse system and the data application system have collaboratively completed the data update based on the first repair verification result and the second repair verification result. The first repair verification result is the verification result obtained by the data supply system after repairing the data quality problem.

[0310] In one embodiment, the data application system 1300 is specifically used for:

[0311] Complete the information acquisition based on data update to obtain data acquisition dependency conditions;

[0312] A data acquisition request is generated according to the data acquisition dependency condition and the first data, and the data acquisition request is sent to the data warehouse system.

[0313] In one embodiment, the data application system 1300 is specifically used for:

[0314] Generate a repair strategy control table according to the data quality problem corresponding to the first data in the collaborative work order and the third data;

[0315] Send the repair strategy control table to the audit terminal;

[0316] Receive the audit result of the audit terminal on the repair strategy control table;

[0317] In response to the audit result being that the audit is passed, the target data is updated according to the third data.

[0318] In one embodiment, the data application system 1300 is specifically used for:

[0319] Determine, according to the collaborative work order, the affected sub-data in the fourth data, where the fourth data is data obtained by processing the first data;

[0320] In response to the affected sub-data matching the target data, a data acquisition request is sent to the data warehouse system according to the first data.

[0321] In one embodiment, the data application system 1300 is specifically used for:

[0322] In response to the affected sub-data not matching the target data, prompt information is sent to the data supply system, where the prompt information is used to indicate that the data application system is not affected by the first data with data quality problems.

[0323] In one embodiment, the data application system 1300 is specifically used for:

[0324] Mark the target data and display the marked target data;

[0325] In response to an update operation on the marked target data, the target data is updated according to the third data.

[0326] Fig.14 A schematic diagram of the hardware structure of a data updating device provided in an embodiment of the present application is shown.

[0327] The data update device may include a processor 1401 and a memory 1402 storing computer program instructions.

[0328] Specifically, the processor 1401 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.

[0329] The memory 1402 may include a large capacity memory for data or instructions. By way of example and not limitation, the memory 1402 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive or a combination of two or more of these. In appropriate cases, the memory 1402 may include a removable or non-removable (or fixed) medium. In appropriate cases, the memory 1402 may be inside or outside the integrated gateway disaster recovery device. In a specific embodiment, the memory 1402 is a non-volatile solid-state memory.

[0330] In certain embodiments, the memory 1402 may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk storage medium device, an optical storage medium device, a flash memory device, an electrical, optical or other physical / tangible memory storage device. Thus, in general, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., a memory device) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method according to an aspect of the present disclosure.

[0331] The processor 1401 implements any one of the authentication methods in the above embodiments by reading and executing computer program instructions stored in the memory 1402 .

[0332] In one example, the data update device may further include a communication interface 1403 and a bus 1410. Fig.14 As shown, the processor 1401, the memory 1402, and the communication interface 1403 are connected via a bus 1410 and communicate with each other.

[0333] The communication interface 1403 is mainly used to implement communication between various modules, devices, units and / or equipment in the embodiments of the present application.

[0334] Bus 1410 includes hardware, software or both, and the parts of online data flow billing equipment are coupled to each other. For example, but not limitation, bus may include accelerated graphics port (AGP) or other graphics bus, enhanced industrial standard architecture (EISA) bus, front-end bus (FSB), hypertransport (HT) interconnection, industrial standard architecture (ISA) bus, infinite bandwidth interconnection, low pin count (LPC) bus, memory bus, micro channel architecture (MCA) bus, peripheral component interconnection (PCI) bus, PCI-Express (PCI-X) bus, serial advanced technology attachment (SATA) bus, video electronics standard association local (VLB) bus or other suitable bus or two or more of these combinations. In appropriate cases, bus 1410 may include one or more buses. Although the present application embodiment describes and shows a specific bus, the present application considers any suitable bus or interconnection.

[0335] The data updating method in the above embodiment can be implemented by providing a computer storage medium in the present application embodiment. The computer storage medium stores computer program instructions; when the computer program instructions are executed by a processor, any one of the data updating methods in the above embodiment is implemented.

[0336] An embodiment of the present application also provides a computer program product, including a computer program, which implements any one of the data updating methods in the above embodiments when the computer program is processed and executed.

[0337] It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, this application is not limited to the order of the above steps, that is, the steps can be performed in the order mentioned in the embodiment, or in a different order from the embodiment, or several steps can be performed simultaneously.

[0338] Aspects of the present disclosure are described above with reference to the flowchart and / or block diagram of the method, device (system) and computer program product according to the embodiment of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data update device to produce a machine so that these instructions executed by the processor of the computer or other programmable data update device enable the implementation of the function / action specified in one or more boxes of the flowchart and / or block diagram. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field programmable logic circuit. It can also be understood that each box in the block diagram and / or flowchart and the combination of boxes in the block diagram and / or flowchart can also be implemented by dedicated hardware that performs a specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions.

[0339] The above are only specific implementation methods of the present application. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, modules and units described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. It should be understood that the protection scope of the present application is not limited to this. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in this application, and these modifications or replacements should be included in the protection scope of this application.

Claims

1. A data updating method, characterized in that: Applied to a data supply system, the data updating method comprises: In response to the data supply system detecting a data quality problem, determining first data affected by the data quality problem and a data application system using the first data, and generating a collaborative work order based on the first data; Repairing the data quality problem to obtain second data and a first repair verification result corresponding to the second data, sending the collaborative work order to the data application system, and sending the second data to the data warehouse system; receiving a second repair verification result sent by the data application system, wherein the second repair verification result is used to indicate the result obtained by the data application system of repairing the data based on third data obtained from the data warehouse system by the collaborative work order, wherein the third data is data obtained by the data warehouse system updating the first data based on the second data; In response to the first repair verification result matching the second repair verification result, it is determined that the data supply system, the data warehouse system, and the data application system collaboratively complete data updating.

2. The data updating method according to claim 1, characterized in that: The step of determining a data application system using the first data comprises: Generate a data acquisition request according to the data quality problem, and send the data acquisition request to the data warehouse system; receiving list information sent by the data warehouse system based on the data sending request, the list information including systems using the first data; A data application system using the first data is determined according to the list information.

3. The data updating method according to claim 2, characterized in that: The step of generating a collaborative work order according to the first data includes: According to the list information, determining in the data warehouse system fourth data associated with the first data, wherein the fourth data is data obtained by processing the first data; A collaborative work order is generated according to the first data and the fourth data.

4. The data updating method according to claim 1, characterized in that: The step of repairing the data quality problem to obtain the second data comprises: Generate a repair strategy control table according to the data quality problem; Sending the repair strategy control table to the audit terminal; receiving the audit result of the repair strategy control table by the audit terminal; In response to the audit result being that the audit is passed, the data quality problem is repaired according to the repair strategy control table to obtain second data.

5. The data updating method according to any one of claims 1 to 4, characterized in that: After the step of receiving the second repair verification result sent by the data application system, the method further includes: In response to the first repair verification result not matching the second repair verification result, sending a data acquisition instruction to the data application system; Receiving first repair record information fed back by the data application system based on the data acquisition instruction, and obtaining second repair record information obtained by the data supply system repairing the data quality problem; Generate repair report information according to the first repair record information and the second repair record information, and send the repair report information to a terminal associated with a repair person.

6. A data updating method, characterized in that: Applied to a data warehouse system, characterized in that the data updating method comprises: receiving second data sent by a data supply system, and determining first data corresponding to the second data in the data warehouse system, wherein the first data is data with data quality problems stored in the data warehouse system by the data supply system, and the second data is data obtained by repairing the data quality problems; updating the first data according to the second data to obtain third data, and sending data update completion information to the data application system; A data acquisition request fed back by the data application system based on the data update completion information is received, and the third data is sent to the data application system, so that the data application system performs data update based on the third data.

7. The data updating method according to claim 6, characterized in that: Before the step of receiving the second data sent by the data supply system, the method further includes: receiving a data acquisition request sent by the data supply system, and determining first data having a data quality problem according to the data acquisition request; determining a data application system according to the first data and fourth data corresponding to the first data, wherein the fourth data is used to indicate data obtained by processing the first data; List information is constructed according to the first data, the fourth data and the data application system, and the list information is fed back to the data supply system.

8. The data updating method according to claim 7, characterized in that: The step of determining a data application system according to the first data and fourth data corresponding to the first data comprises: Determine the processed data corresponding to the first data and the target sub-data in the first data, the target sub-data is used to forward data to the setting system, and the fourth data includes the target sub-data and the processed data; A port for receiving the first data is determined, and a system where the port is located, a system for receiving the processed data, and a system for receiving the target sub-data are all determined as data application systems.

9. The data updating method according to claim 6, characterized in that: The step of updating the first data according to the second data to obtain the third data comprises: Generate a repair strategy control table according to the data quality problem corresponding to the first data; Sending the repair strategy control table to the audit terminal; receiving the audit result of the repair strategy control table by the audit terminal; In response to the audit result being passed, the first data is updated according to the repair strategy control table and the second data to obtain third data.

10. The data updating method according to claim 6, characterized in that: The step of sending data update completion information to the data application system comprises: Determining a data acquisition dependency condition according to the third data; Data update completion information is generated according to the data acquisition dependency condition, and the data update completion information is sent to the data supply system.

11. A data updating method, characterized in that: Applied to a data supply system, the data updating method comprises: Receiving a collaborative work order sent by a data supply system, and determining, in the data supply system according to the collaborative work order, target data associated with first data, where the first data is data in the collaborative work order indicating a data quality problem; Receive data update completion information sent by the data warehouse system; In response to the data updated by the data update completion information being the first data, sending a data acquisition request to the data warehouse system according to the first data; receiving third data fed back by the data warehouse system based on the data acquisition request, and updating the target data according to the third data, wherein the third data is data obtained by the data warehouse system updating the first data based on the second data, and the second data is data obtained by the data supply system repairing data quality problems; A second repair verification result is obtained based on the updated target data, and the second repair verification result is sent to the data supply system, so that the data supply system can determine whether the data supply system, the data warehouse system and the data application system have collaboratively completed the data update based on the first repair verification result and the second repair verification result. The first repair verification result is the verification result obtained by the data supply system after repairing the data quality problem.

12. The data updating method according to claim 11, characterized in that: The step of sending a data acquisition request to the data warehouse system according to the first data comprises: Acquiring data acquisition dependency conditions according to the data update completion information; A data acquisition request is generated according to the data acquisition dependency condition and the first data, and the data acquisition request is sent to the data warehouse system.

13. The data updating method according to claim 11, characterized in that: The step of updating the target data according to the third data comprises: generating a repair strategy control table according to the data quality problem corresponding to the first data in the collaborative work order and the third data; Sending the repair strategy control table to the audit terminal; receiving the audit result of the repair strategy control table by the audit terminal; In response to the audit result being that the audit is passed, the target data is updated according to the third data.

14. The data updating method according to claim 11, characterized in that: The step of sending a data acquisition request to the data warehouse system according to the first data comprises: Determine, according to the collaborative work order, in fourth data, the affected sub-data, wherein the fourth data is data obtained by processing the first data; In response to the affected sub-data matching the target data, a data acquisition request is sent to the data warehouse system according to the first data.

15. The data updating method according to claim 14, characterized in that: The step of determining the affected sub-data, wherein the fourth data is data obtained by processing the first data, comprises: In response to the affected sub-data not matching the target data, prompt information is sent to the data supply system, where the prompt information is used to indicate that the data application system is not affected by the first data with data quality problems.

16. The data updating method according to claim 11, characterized in that: The step of updating the target data according to the third data comprises: Marking the target data, and displaying the marked target data; In response to an update operation on the marked target data, the target data is updated according to the third data.

17. A data provision system, characterized in that: include: A first determination module is used to determine, in response to the data supply system detecting a data quality problem, first data affected by the data quality problem and a data application system using the first data, and generate a collaborative work order according to the first data; A repair module, used to repair the data quality problem to obtain second data and a first repair verification result corresponding to the second data, and send the collaborative work order to the data application system, and send the second data to the data warehouse system; a receiving module, configured to receive a second repair verification result sent by the data application system, wherein the second repair verification result is used to indicate to the data application system a result of repairing the data based on third data obtained from the data warehouse system by the collaborative work order, wherein the third data is data obtained by the data warehouse system updating the first data based on the second data; The second determination module is used to determine that the data supply system, the data warehouse system and the data application system collaboratively complete data update in response to the first repair verification result matching the second repair verification result.

18. A data warehouse system, characterized in that: include: A first receiving module is used to receive second data sent by a data supply system, and determine first data corresponding to the second data in the data warehouse system, wherein the first data is data with data quality problems stored in the data warehouse system by the data supply system, and the second data is data obtained by repairing the data quality problems; An updating module, configured to update the first data according to the second data to obtain third data, and send data updating completion information to the data application system; The second receiving module is used to receive a data acquisition request fed back by the data application system based on the data update completion information, and send the third data to the data application system so that the data application system can perform data update based on the third data.

19. A data provision system, characterized in that: include: A first receiving module is used to receive a collaborative work order sent by a data supply system, and determine target data associated with first data in the data supply system according to the collaborative work order, where the first data is data indicating a data quality problem in the collaborative work order; The second receiving module is used to receive the data update completion information sent by the data warehouse system; A sending module, configured to send a data acquisition request to the data warehouse system according to the first data in response to the data updated by the data update completion information being the first data; a third receiving module, configured to receive third data fed back by the data warehouse system based on the data acquisition request, and update the target data according to the third data, wherein the third data is data obtained by the data warehouse system updating the first data based on the second data, and the second data is data obtained by the data supply system repairing data quality problems; An acquisition module is used to obtain a second repair verification result based on the updated target data, and send the second repair verification result to the data supply system, so that the data supply system can determine whether the data supply system, the data warehouse system and the data application system have collaboratively completed the data update based on the first repair verification result and the second repair verification result. The first repair verification result is a verification result obtained by the data supply system after repairing the data quality problem.

20. A data updating device, characterized in that: The device comprises: a processor and a memory storing computer program instructions; when the processor executes the computer program instructions, the data updating method according to any one of claims 1 to 16 is implemented.

21. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer program instructions, and when the computer program instructions are executed by a processor, the data updating method according to any one of claims 1 to 16 is implemented.

22. A computer program product, characterized in that When the instructions in the computer program product are executed by a processor of an electronic device, the electronic device is enabled to execute the data updating method as described in any one of claims 1 to 16.

Images