Data cleaning method and device, related equipment and storage medium

Abstract

The invention discloses a data cleaning method and device, a cloud platform, a client and a storage medium, and relates to the technical field of data cleaning. The method comprises the steps that a cloud platform obtains a data cleaning request of a client and obtains to-be-cleaned data corresponding to the data cleaning request, and a network where a server corresponding to the client is located is different from a network where a server corresponding to the cloud platform is located; performing data cleaning on the to-be-cleaned data, and monitoring a data cleaning process; wherein when a data cleaning result is monitored within a first time length and the data cleaning result meets a first condition, the data cleaning result is sent to the client; and under the condition that the data cleaning result is not monitored within the first time length, or under the condition that the data cleaning result is monitored within the first time length and the data cleaning result does not meet a first condition, sending notification information to the client, the notification information representing that data cleaning fails.

Description

Technical Field

[0001] The present application relates to the technical field of data cleaning, and in particular to a data cleaning method, apparatus, related equipment and storage medium. Background Art

[0002] At present, the data verification logic of Internet products has gradually matured, and the data verification models have gradually become richer and more diverse. Different data types can be summarized and processed using different data verification models. Some companies have also begun to transform their service model from Platform-as-a-Service (PaaS) to Software-as-a-Service (SaaS). However, data cleaning through SaaS has always remained in the conceptual design stage.

[0003] In the related technologies, data cleaning demanders usually use intranet services within the company to perform data cleaning. However, there is no effective solution in the related technologies for how to use the external network to filter the entire data, that is, how to achieve data cleaning through the external network. Summary of the invention

[0004] To solve the related technical problems, the embodiments of the present application provide a data cleaning method, apparatus, related equipment and storage medium.

[0005] The technical solution of the embodiment of the present application is implemented as follows:

[0006] The present application embodiment provides a data cleaning method, which is applied to a cloud platform, including:

[0007] Obtaining a data cleaning request from a client, and obtaining the to-be-cleaned data corresponding to the data cleaning request, wherein a network where a server corresponding to the client is located is different from a network where a server corresponding to the cloud platform is located;

[0008] The data to be cleaned is cleaned, and the process of data cleaning is monitored; wherein, if the data cleaning result is monitored within a first time period and the data cleaning result meets a first condition, the data cleaning result is sent to the client; if the data cleaning result is not monitored within the first time period, or if the data cleaning result is monitored within the first time period and the data cleaning result does not meet the first condition, a notification message is sent to the client, and the notification message indicates that the data cleaning has failed; the first condition indicates that the number of data items in the data cleaning result is the same as the number of data items in the data to be cleaned.

[0009] In the above solution, the data to be cleaned acquired by the cloud platform is data encrypted by the client using the first method, and the data cleaning of the data to be cleaned includes:

[0010] Decrypting the acquired data to be cleaned using a second method, where the second method is symmetrical to the first method;

[0011] Perform data cleaning on the decrypted data to be cleaned.

[0012] In the above solution, the data cleaning of the data to be cleaned includes:

[0013] Splitting the task of cleaning the data to be cleaned into multiple subtasks, each subtask corresponding to a portion of the data to be cleaned;

[0014] Performing distributed parallel processing on the multiple subtasks to obtain the data cleaning result;

[0015] The data cleaning result is stored in a preset cache space.

[0016] In the above solution, the distributed parallel processing of the multiple subtasks includes:

[0017] For each of the multiple subtasks, a preset data cleaning model is matched with a portion of the data to be cleaned corresponding to the subtask at a field level to obtain a partial data cleaning result corresponding to the subtask; wherein the preset data cleaning model is used to clean the data to be cleaned that meets a second condition, and the second condition indicates that the data to be cleaned contains sensitive data.

[0018] In the above solution, monitoring the data cleaning process includes:

[0019] Within the first time period, N queries are performed to determine whether the cache space stores the data cleaning result, each of the N queries is separated from the previous query by a second time period, the second time period is less than the first time period, and N is an integer greater than 1; wherein,

[0020] In the case that it is queried that the data cleaning result is stored in the cache space, it is determined that the data cleaning result is monitored within the first time period, and it is determined whether the data cleaning result meets the first condition.

[0021] In the above scheme, the method further comprises:

[0022] When the data cleaning result does not satisfy the first condition, the data cleaning result is deleted from the cache space.

[0023] The present application also provides a data cleaning method, which is applied to a client and includes:

[0024] Sending a data cleaning request to the cloud platform, and sending the to-be-cleaned data corresponding to the data cleaning request to the cloud platform, so that the cloud platform cleans the to-be-cleaned data, and monitors the data cleaning process, wherein the network where the server corresponding to the client is located is different from the network where the server corresponding to the cloud platform is located;

[0025] Receive a data cleaning result or notification information sent by the cloud platform, the notification information indicating that the data cleaning failed; wherein, the data cleaning result is sent when the cloud platform monitors the data cleaning result within a first time period and the data cleaning result meets a first condition; the notification information is sent when the cloud platform does not monitor the data cleaning result within the first time period, or the notification information is sent when the cloud platform monitors the data cleaning result within the first time period and the data cleaning result does not meet the first condition; the first condition indicates that the number of data items in the data cleaning result is the same as the number of data items in the data to be cleaned.

[0026] In the above solution, the sending of the to-be-cleaned data corresponding to the data cleaning request to the cloud platform includes:

[0027] The data to be cleaned is encrypted in a first manner, and the encrypted data to be cleaned is sent to the cloud platform; the first manner is symmetrical to the second manner of the cloud platform, and the second manner is used to decrypt the encrypted data to be cleaned.

[0028] The embodiment of the present application also provides a data cleaning device, which is arranged on a cloud platform and includes:

[0029] A first acquisition unit is used to acquire a data cleaning request from a client, wherein a network where a server corresponding to the client is located is different from a network where a server corresponding to the cloud platform is located;

[0030] A second acquiring unit, configured to acquire the data to be cleaned corresponding to the data cleaning request;

[0031] A cleaning unit, used for cleaning the data to be cleaned;

[0032] A monitoring unit, used for monitoring the data cleaning process;

[0033] A first sending unit is used to send the data cleaning result to the client when the data cleaning result is monitored within a first time period and the data cleaning result meets a first condition; send notification information to the client when the data cleaning result is not monitored within the first time period, or when the data cleaning result is monitored within the first time period and the data cleaning result does not meet the first condition, the notification information indicates that the data cleaning has failed; the first condition indicates that the number of data items in the data cleaning result is the same as the number of data items of the data to be cleaned.

[0034] The embodiment of the present application also provides a data cleaning device, which is arranged on a client and includes:

[0035] A second sending unit is used to send a data cleaning request to the cloud platform, and send the to-be-cleaned data corresponding to the data cleaning request to the cloud platform, so that the cloud platform performs data cleaning on the to-be-cleaned data, and monitors the data cleaning process, wherein the network where the server corresponding to the client is located is different from the network where the server corresponding to the cloud platform is located;

[0036] A receiving unit, used to receive a data cleaning result or notification information sent by the cloud platform, wherein the notification information indicates that the data cleaning has failed; wherein the data cleaning result is sent when the cloud platform monitors the data cleaning result within a first time period and the data cleaning result meets a first condition; the notification information is sent when the cloud platform does not monitor the data cleaning result within the first time period, or the notification information is sent when the cloud platform monitors the data cleaning result within the first time period and the data cleaning result does not meet the first condition; the first condition indicates that the number of data items in the data cleaning result is the same as the number of data items in the data to be cleaned.

[0037] The embodiment of the present application further provides a cloud platform, comprising: a first processor and a first memory for storing a computer program that can be run on the processor,

[0038] Wherein, the first processor is used to execute the steps of any of the above-mentioned methods on the cloud platform side when running the computer program.

[0039] The embodiment of the present application further provides a client, comprising: a second processor and a second memory for storing a computer program that can be run on the processor,

[0040] Wherein, the second processor is used to execute the steps of any of the above-mentioned client-side methods when running the computer program.

[0041] An embodiment of the present application also provides a storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of any of the above-mentioned methods on the cloud platform side are implemented, or the steps of any of the above-mentioned methods on the client side are implemented.

[0042] The data cleaning method, apparatus, related equipment and storage medium provided in the embodiments of the present application, the cloud platform obtains a data cleaning request from a client, and obtains the data to be cleaned corresponding to the data cleaning request, the network where the server corresponding to the client is located is different from the network where the server corresponding to the cloud platform is located; the data to be cleaned is cleaned, and the process of data cleaning is monitored; wherein, if the data cleaning result is monitored within a first time period and the data cleaning result meets a first condition, the data cleaning result is sent to the client; if the data cleaning result is not monitored within the first time period, or if the data cleaning result is monitored within the first time period and the data cleaning result does not meet the first condition, a notification message is sent to the client, the notification message indicating that the data cleaning failed; the first condition indicates that the number of data items in the data cleaning result is the same as the number of data items in the data to be cleaned.

[0043] Because the network where the server corresponding to the client is located is different from the network where the server corresponding to the cloud platform is located, the cloud platform can be understood as the external network of the client, so the cloud platform performs data cleaning on the data to be cleaned of the client according to the data cleaning request of the client, so that the solution provided by the embodiment of the present application can realize data cleaning through the external network, that is, it can use the external network for full data filtering; because the cloud platform monitors the process of data cleaning, and monitors the data cleaning result within the specified time (that is, the first time) and the data cleaning result is complete (that is, the number of data items of the data cleaning result is the same as the number of data items of the data to be cleaned) to the client, the solution provided by the embodiment of the present application can limit the time of data cleaning, so as to avoid the data cleaning time being too long under the premise of ensuring the completeness of the data cleaning result. In summary, the solution provided by the embodiment of the present application can realize the data cleaning service on the cloud, that is, it can realize data cleaning through the SaaS method; and it can effectively improve the support capability of the third-party service (that is, the service provided by the cloud platform to the client) for data cleaning, that is, it can avoid the problem of excessive delay caused by the data cleaning request of the client due to the use of the data cleaning service of the cloud platform, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 A flowchart of a data cleaning method according to an embodiment of the present application;

[0045] Figure 2A flowchart of another data cleaning method according to an embodiment of the present application;

[0046] Figure 3 This is a schematic diagram of the data cleaning process on the cloud for this application example;

[0047] Figure 4 This is a schematic diagram of the data cleaning lane on the cloud for this application example;

[0048] Figure 5 This is a diagram of the structure of the data cleaning model table for this application example;

[0049] Figure 6 This is a schematic diagram of the structure of a data cleaning device according to an embodiment of the present application;

[0050] Figure 7 This is a schematic diagram of the structure of another data cleaning device according to an embodiment of the present application;

[0051] Figure 8 This is a schematic diagram of the cloud platform structure of the embodiment of the present application;

[0052] Fig. 9 This is a schematic diagram of the client structure of an embodiment of the present application;

[0053] Fig.10 This is a schematic diagram of the structure of the data cleaning system according to an embodiment of the present application. DETAILED DESCRIPTION

[0054] The present application is further described in detail below in conjunction with the accompanying drawings and embodiments.

[0055] The main reasons why related technologies cannot achieve data cleaning through the extranet (extranet refers to the relationship between two different networks that are not in the same computer room or server deployment area. Even if it is two networks of the same company, for any one network, the other network belongs to the extranet) include:

[0056] Reason 1: Data security cannot be guaranteed;

[0057] Reason 2: Data request delay (i.e. latency) and data transmission speed cannot be guaranteed.

[0058] Among them, data request delay refers to the time required for a request to be sent from server A at the service initiator to server B at the service receiver, and then returned to A after B completes the processing. This time depends on the degree of involvement of the external network data cleaning logic C (i.e., the dedicated server or service logic for data cleaning). In addition, the higher the data request delay of the process, the lower the data transmission speed. For example, the data transmission speed of A->C->B will obviously be much smaller than the data transmission speed of A->C, that is, the data request delay of A->C->B will obviously be much larger than the data request delay of A->C.

[0059] Therefore, in order to implement data cleaning through the external network, the problems that need to be solved in the embodiments of the present application include:

[0060] Question 1: How to ensure data transmission speed in cloud data cleaning?

[0061] Question 2: How to ensure data security during cloud data cleaning?

[0062] Question 3: How to ensure effective interception of sensitive data during cloud data cleaning?

[0063] Based on this, in various embodiments of the present application, the network where the server corresponding to the client is located is different from the network where the server corresponding to the cloud platform is located. The cloud platform performs data cleaning on the client's data to be cleaned according to the client's data cleaning request, and monitors the data cleaning process. When the data cleaning result is monitored within a specified time period and the data cleaning result is complete (that is, the number of data items in the data cleaning result is the same as the number of data items in the data to be cleaned), the data cleaning result is fed back to the client, thereby effectively improving the support capability of the third-party service (that is, the service provided by the cloud platform to the client) for data cleaning, that is, it can avoid the problem of excessive delay in the client's data cleaning request due to the use of the cloud platform's data cleaning service, that is, it solves the above-mentioned problem 1, thereby improving the user experience.

[0064] The present application embodiment provides a data cleaning method, which is applied to a cloud platform, such as Figure 1 As shown, the method includes:

[0065] Step 101: obtaining a data cleaning request from a client, and obtaining the to-be-cleaned data corresponding to the data cleaning request, wherein the network where the server corresponding to the client is located is different from the network where the server corresponding to the cloud platform is located;

[0066] Step 102: Clean the data to be cleaned and monitor the process of data cleaning; wherein, if the data cleaning result is monitored within a first time period and the data cleaning result meets a first condition, the data cleaning result is sent to the client; if the data cleaning result is not monitored within the first time period, or if the data cleaning result is monitored within the first time period and the data cleaning result does not meet the first condition, a notification message is sent to the client, the notification message indicating that the data cleaning has failed; the first condition indicates that the number of data items in the data cleaning result is the same as the number of data items in the data to be cleaned.

[0067] In actual application, the specific content of the data cleaning request can be set according to the needs; illustratively, the data cleaning request can include the client identifier, the data volume of the data to be cleaned (such as the number of data items), etc. The client identifier can include the server identifier (such as the server ID) or the Internet Protocol (IP) address, etc. In addition, the type of the data to be cleaned and the specific content included can also be set according to the needs, and the embodiments of the present application do not limit this.

[0068] In actual application, the size of the first duration can be set according to demand; for example, the first duration can be set to 5 seconds (s), 10s, 15s, etc. according to the restriction on the number of data items by the cloud service interface of the cloud platform.

[0069] In actual application, in the data to be cleaned and the data cleaning result, each piece of data may correspond to a unique data identifier (such as an ID), and the cloud platform may determine whether the data cleaning result meets the first condition by comparing the data identifier in the data to be cleaned and the data identifier in the data cleaning result.

[0070] In actual application, the first condition can be specifically set according to the needs. For example, when the verification result obtained by verifying the data identifiers in the data to be cleaned and the data identifiers in the data cleaning result indicates that the number of data items in the data cleaning result is the same as the number of data items in the data to be cleaned, it can be determined that the data cleaning result meets the first condition; when the verification result obtained by verifying the data identifiers in the data to be cleaned and the data identifiers in the data cleaning result indicates that the number of data items in the data cleaning result is different from the number of data items in the data to be cleaned, it can be determined that the data cleaning result does not meet the first condition.

[0071] In actual application, for the above-mentioned problem 2, in order to ensure data security during cloud data cleaning, the client and the cloud platform can transmit encrypted data, that is, the client can encrypt the data to be cleaned and send the encrypted data to be cleaned to the cloud platform; the cloud platform can decrypt the acquired data to be cleaned, and then clean the decrypted data to be cleaned.

[0072] Based on this, in one embodiment, the data to be cleaned acquired by the cloud platform may be data encrypted by the client using the first method, and the data cleansing of the data to be cleaned may include:

[0073] Decrypting the acquired data to be cleaned using a second method, where the second method is symmetrical to the first method;

[0074] Perform data cleaning on the decrypted data to be cleaned.

[0075] Here, it can be understood that the first method is used to encrypt the data to be cleaned to obtain the encrypted data to be cleaned; the second method is used to decrypt the encrypted data to be cleaned to obtain the decrypted data to be cleaned. In actual application, the specific implementation of the first method and the second method can be set according to needs, such as symmetric encryption keys, etc., which are not limited in this embodiment of the present application. Because the encrypted data to be cleaned is transmitted between the client and the cloud platform, data security can be guaranteed in cloud data cleaning, which solves the above-mentioned problem 2.

[0076] In actual application, in order to further improve the data transmission speed in cloud data cleaning, that is, to further reduce the data request delay, the cloud platform can specifically use a distributed parallel processing method to clean the data to be cleaned.

[0077] Based on this, in one embodiment, the data cleaning of the data to be cleaned may include:

[0078] Splitting the task of cleaning the data to be cleaned into multiple subtasks, each subtask corresponding to a portion of the data to be cleaned;

[0079] Performing distributed parallel processing on the multiple subtasks to obtain the data cleaning result;

[0080] The data cleaning result is stored in a preset cache space.

[0081] Here, when storing the data cleaning result, a verification result obtained by verifying the data identifier in the data to be cleaned and the data identifier in the data cleaning result may also be stored in the cache space.

[0082] In actual application, for the above question 3, in order to ensure effective interception of sensitive data in cloud data cleaning, conditional restrictions that can accurately match the data cleaning scope (i.e., sensitive data) can be added to the data cleaning model in advance, or it can be understood as using a data cleaning model with a strategy that can accurately match the data cleaning scope (i.e., sensitive data) to perform data cleaning.

[0083] Based on this, in one embodiment, the distributed parallel processing of the multiple subtasks may include:

[0084] For each of the multiple subtasks, a preset data cleaning model is matched with a portion of the data to be cleaned corresponding to the subtask at a field level to obtain a partial data cleaning result corresponding to the subtask; wherein the preset data cleaning model is used to clean the data to be cleaned that meets a second condition, and the second condition indicates that the data to be cleaned contains sensitive data.

[0085] Among them, in actual application, the second condition can be understood as a conditional restriction on the data cleaning model that can accurately match the data cleaning scope (i.e., sensitive data), or can be understood as a strategy that can accurately match the data cleaning scope (i.e., sensitive data) that is attached / carried / included by the data cleaning model, and the specific content of the second condition can be set according to demand. Exemplarily, the second condition may include sensitive values, sensitive fields, sensitive ranges, etc., that is, when the data to be cleaned contains sensitive values, sensitive fields, sensitive ranges, etc. restricted by the second condition, it can be determined that the data to be cleaned contains sensitive data, that is, it is determined that the data to be cleaned meets the second condition. Because when the cloud platform performs data cleaning, the data cleaning model and the part of the data to be cleaned corresponding to each subtask are matched step by step at the field level, and the data cleaning model is attached / carried / included with a strategy that can accurately match the data cleaning scope (i.e., sensitive data), it can more accurately match the data cleaning scope (i.e., sensitive data) in cloud data cleaning, so that sensitive data can be effectively intercepted in cloud data cleaning, that is, the above-mentioned problem 3 is solved.

[0086] In actual application, during the process of monitoring the data cleaning process, the cloud platform may perform multiple inquiries on whether the cache space stores the data cleaning result, so as to determine whether the data cleaning result is monitored within the first time period.

[0087] Based on this, in one embodiment, monitoring the process of data cleaning may include:

[0088] Within the first time period, N queries are performed to determine whether the cache space stores the data cleaning result, each of the N queries is separated from the previous query by a second time period, the second time period is less than the first time period, and N is an integer greater than 1; wherein,

[0089] In the case that it is queried that the data cleaning result is stored in the cache space, it is determined that the data cleaning result is monitored within the first time period, and it is determined whether the data cleaning result meets the first condition.

[0090] In actual application, the value of N can be set according to demand, such as 2, 3, 4, 5, etc.; the size of the second time length can also be set according to demand, such as 200 milliseconds (ms), etc. In addition, it can be understood that the N queries for whether the cache space stores the data cleaning result means that at most N queries are made for whether the cache space stores the data cleaning result, that is, the number of queries for whether the cache space stores the data cleaning result is less than or equal to N; exemplarily, when the value of N is 3, if the cloud platform finds that the cache space stores the data cleaning result in the second query, the query can be stopped, and it is determined that the data cleaning result is heard within the first time length; if the cloud platform still does not find that the cache space stores the data cleaning result in the third query, it can be determined that the data cleaning result is not heard within the first time length, that is, it can be determined that the data cleaning has failed.

[0091] In actual application, if the data cleaning result does not meet the first condition, it means that the data cleaning has failed. At this time, if the data cleaning result is obtained by the cloud platform performing relevant database operations on the data to be cleaned, the cloud platform needs to roll back and restore the data cleaning result to the data to be cleaned so that the cloud platform can re-clean the data later; if the data cleaning result is generated by the cloud platform in a new database, the cloud platform does not need to roll back and can directly delete the data cleaning result, thereby saving storage space.

[0092] Based on this, in one embodiment, the method may further include:

[0093] When the data cleaning result does not satisfy the first condition, the data cleaning result is deleted from the cache space.

[0094] In actual application, each step of the data cleaning method provided by one or more technical solutions on the cloud platform side of the above-mentioned embodiment of the present application can be executed by the same or different services of the cloud platform; and different services of the cloud platform can be implemented by the same server or by different servers. Exemplarily, the cloud platform can provide a first service, a second service, a third service, a fourth service and a fifth service; wherein, the client can send the data cleaning request and the data to be cleaned to the cloud platform; the first service can serve as the entrance to the cloud service, receive the data cleaning request of the client, and send the data cleaning request to the second service; the third service can receive the data to be cleaned and generate a task to clean the data to be cleaned; the fourth service can subscribe to the data cleaning task from the third service, execute the data cleaning task, obtain the data cleaning result, and send the data cleaning result to the fifth service; the fifth service can store the data cleaning result in a preset cache space; after the second service obtains / receives the data cleaning request sent by the first service, it can monitor the data cleaning request sent by the first service. The process of data cleaning by the fourth service is, that is, within the first time period, N queries are made to the fifth service regarding whether the data cleaning result is stored in the cache space; if the data cleaning result is heard within the first time period and the data cleaning result meets the first condition, the second service may send the data cleaning result to the first service, and then the first service sends the data cleaning result to the client; if the data cleaning result is not heard within the first time period, or if the data cleaning result is heard within the first time period and the data cleaning result does not meet the first condition, the second service may send the notification information to the first service, and then the first service sends the notification information to the client; after receiving the notification information, the client may re-initiate the data cleaning request as needed.

[0095] Accordingly, the embodiment of the present application also provides a data cleaning method, which is applied to a client, such as Figure 2 As shown, the method includes:

[0096] Step 201: Send a data cleaning request to a cloud platform, and send the to-be-cleaned data corresponding to the data cleaning request to the cloud platform, so that the cloud platform cleans the to-be-cleaned data and monitors the data cleaning process, wherein the network where the server corresponding to the client is located is different from the network where the server corresponding to the cloud platform is located;

[0097] Step 202: Receive the data cleaning result or notification information sent by the cloud platform, the notification information indicating that the data cleaning has failed; wherein, the data cleaning result is sent when the cloud platform monitors the data cleaning result within a first time period and the data cleaning result meets a first condition; the notification information is sent when the cloud platform does not monitor the data cleaning result within the first time period, or the notification information is sent when the cloud platform monitors the data cleaning result within the first time period and the data cleaning result does not meet the first condition; the first condition indicates that the number of data items in the data cleaning result is the same as the number of data items in the data to be cleaned.

[0098] In one embodiment, the sending of the to-be-cleaned data corresponding to the data cleaning request to the cloud platform may include:

[0099] The data to be cleaned is encrypted in a first manner, and the encrypted data to be cleaned is sent to the cloud platform; the first manner is symmetrical to the second manner of the cloud platform, and the second manner is used to decrypt the encrypted data to be cleaned.

[0100] The data cleaning method provided in the embodiment of the present application comprises the following steps: a cloud platform obtains a data cleaning request from a client, and obtains data to be cleaned corresponding to the data cleaning request, wherein the network where the server corresponding to the client is located is different from the network where the server corresponding to the cloud platform is located; data cleaning is performed on the data to be cleaned, and the process of data cleaning is monitored; wherein, if a data cleaning result is monitored within a first time period and the data cleaning result satisfies a first condition, the data cleaning result is sent to the client; if no data cleaning result is monitored within the first time period, or if a data cleaning result is monitored within the first time period and the data cleaning result does not meet the first condition, a notification message is sent to the client, and the notification message indicates that data cleaning has failed; and the first condition indicates that the number of data items in the data cleaning result is the same as the number of data items in the data to be cleaned. In the solution provided by the embodiment of the present application, the network where the server corresponding to the client is located is different from the network where the server corresponding to the cloud platform is located. The cloud platform cleans the data to be cleaned of the client according to the data cleaning request of the client, and monitors the process of data cleaning. When the data cleaning result is monitored within a specified time period (i.e., the first time period) and the data cleaning result is complete (i.e., the number of data items in the data cleaning result is the same as the number of data items in the data to be cleaned), the data cleaning result is fed back to the client, thereby effectively improving the support capability of the third-party service (i.e., the service provided by the cloud platform to the client) for data cleaning, that is, it can avoid the problem of excessive delay in the client's data cleaning request due to the use of the data cleaning service of the cloud platform, that is, it solves the above-mentioned problem 1, thereby improving the user experience.

[0101] At the same time, the solution provided in the embodiment of the present application can ensure data security during cloud data cleaning because the data to be cleaned is encrypted and transmitted between the client and the cloud platform, thereby solving the above-mentioned problem 2.

[0102] In addition, the solution provided in the embodiment of the present application, because when the cloud platform performs data cleaning, the data cleaning model and the part of the data to be cleaned corresponding to each subtask are matched step by step at the field level, and the data cleaning model is accompanied by / carries / includes a strategy that can accurately match the data cleaning scope (i.e., sensitive data), so it is possible to more accurately match the data cleaning scope (i.e., sensitive data) in cloud data cleaning, thereby ensuring effective interception of sensitive data in cloud data cleaning, thereby solving the above-mentioned problem 3.

[0103] The present application is described in further detail below in conjunction with application examples.

[0104] In this application example, the data cleaning method provided by one or more technical solutions on the cloud platform side is executed by the first service, the second service, the third service, the fourth service and the fifth service; wherein the first service is called A service (also referred to as service A, abbreviated as A), the second service is called B service (also referred to as service B, abbreviated as B), the third service is called C1 service (also referred to as service C1, abbreviated as C1), the fourth service is called C service (also referred to as service C, abbreviated as C), and the fifth service is called D service (also referred to as service D, abbreviated as D).

[0105] In this application example, Figure 3As shown, service A initiates message queue C1 while requesting service B, then service C subscribes to message queue C1, executes data cleaning task, and stores task result in cache D; after data cleaning task is processed, service B checks task result in cache D, which includes not only data cleaning result but also comparison result of data before and after cleaning (i.e., the verification result mentioned above). After verifying task result, service B decides whether current task needs to be rolled back. Among them, the requester and cloud data cleaning server verify symmetric encryption key with each other, that is, the client and the cloud platform need to verify symmetric encryption key with each other, specifically, C1 or service C and the client can verify symmetric encryption key with each other, so as to ensure data security, structural security and data cleaning effect. Specifically, first, the data that needs to be cleaned in the request sent by service A needs to be retained in the message queue C1 task, the cleaning service is executed through service C, and then the result is transferred to cache service D; when service B is ready to submit a MySQL or Oracle database transaction or return the result to service A (that is, when the first time period expires), it is necessary to check the task result in cache service D. When cache D contains the task result, the submission is performed according to the task result, that is, when the data comparison result indicates that the data cleaning result is complete, the data cleaning result is returned to service A, and / or the data cleaning result is stored in the corresponding database; or the data is rolled back according to the task result, that is, when the data comparison result indicates that the data cleaning result is incomplete, the data is rolled back, and a notification of data cleaning failure is returned to service A.

[0106] In this application example, Figure 4 As shown in the figure, when there is no task result in cache D, the query can be repeated up to 3 times (that is, the value of N is 3), with an interval of 200ms (that is, the second duration mentioned above). If there is no result after 3 queries, the cleaning is considered to have failed. At the same time, the maximum cleaning duration (that is, the first duration mentioned above) can be set in the cleaning service C, and Figure 5 The cleaning model table of the structure shown (i.e. the above-mentioned data cleaning model) uses multi-threading to execute the cleaning of a JavaScript object notation (JSON) (here one JSON can correspond to one piece of data). In order to avoid data cleaning timeout, it is assumed that the maximum time is M (i.e. the above-mentioned first duration is M, and the value of M can be set according to demand). When it is close to (M-400) ms (400 ms = 200 ms*2 of each interval, i.e. before the last query), CountDownLatch can be used to perform a separate check on the completed tasks (i.e. compare whether the IDs before and after data cleaning are consistent). If there is any inconsistency in the check, the identifier Boollean1 that indicates the inconsistency between the cleaned data and the uncleaned data can be directly returned to the cache. The cache data structure is shown in Table 1.

[0107]

[0108]

[0109] Table 1

[0110] The solution provided in this application example designs a technical solution for automatic cloud data cleaning, which performs data cleaning and proofreading without affecting the timeliness of the request, and verifies the data in a later form (i.e., after data cleaning, compares whether the data IDs before and after data cleaning are consistent), thereby realizing cloud data cleaning services, which can effectively enhance the support capabilities of third-party services for data cleaning, and at the same time solve the problem of excessive delay in the request process caused by the use of data cleaning services.

[0111] In order to implement the method on the cloud platform side of the embodiment of the present application, the embodiment of the present application also provides a data cleaning device, which is arranged on the cloud platform, such as Figure 6 As shown, the device comprises:

[0112] The first acquisition unit 601 is used to acquire a data cleaning request from a client, where the network where the server corresponding to the client is located is different from the network where the server corresponding to the cloud platform is located;

[0113] A second acquisition unit 602 is used to acquire the to-be-cleaned data corresponding to the data cleaning request;

[0114] A cleaning unit 603 is used to clean the data to be cleaned;

[0115] A monitoring unit 604 is used to monitor the data cleaning process;

[0116] The first sending unit 605 is used to send the data cleaning result to the client when the data cleaning result is monitored within the first time period and the data cleaning result meets the first condition; send notification information to the client when the data cleaning result is not monitored within the first time period, or when the data cleaning result is monitored within the first time period and the data cleaning result does not meet the first condition, the notification information indicates that the data cleaning has failed; the first condition indicates that the number of data items in the data cleaning result is the same as the number of data items of the data to be cleaned.

[0117] In one embodiment, the data to be cleaned acquired by the cloud platform is data encrypted by the client using the first method, and the cleaning unit 603 is further used to:

[0118] Decrypting the acquired data to be cleaned using a second method, where the second method is symmetrical to the first method;

[0119] Perform data cleaning on the decrypted data to be cleaned.

[0120] In one embodiment, the cleaning unit 603 is further used for:

[0121] Splitting the task of cleaning the data to be cleaned into multiple subtasks, each subtask corresponding to a portion of the data to be cleaned;

[0122] Performing distributed parallel processing on the multiple subtasks to obtain the data cleaning result;

[0123] The data cleaning result is stored in a preset cache space.

[0124] In one embodiment, the cleaning unit 603 is further used for:

[0125] For each of the multiple subtasks, a preset data cleaning model is matched with a portion of the data to be cleaned corresponding to the subtask at a field level to obtain a partial data cleaning result corresponding to the subtask; wherein the preset data cleaning model is used to clean the data to be cleaned that meets a second condition, and the second condition indicates that the data to be cleaned contains sensitive data.

[0126] In one embodiment, the monitoring unit 604 is further configured to:

[0127] Within the first time period, N queries are performed to determine whether the cache space stores the data cleaning result, each of the N queries is separated from the previous query by a second time period, the second time period is less than the first time period, and N is an integer greater than 1; wherein,

[0128] In the case that it is queried that the data cleaning result is stored in the cache space, it is determined that the data cleaning result is monitored within the first time period, and it is determined whether the data cleaning result meets the first condition.

[0129] In one embodiment, the monitoring unit 604 is further configured to delete the data cleaning result from the cache space if the data cleaning result does not satisfy the first condition.

[0130] In actual application, the first acquisition unit 601 and the second acquisition unit 602 can be implemented by a processor in the data cleaning device in combination with a communication interface; the cleaning unit 603 and the monitoring unit 604 can be implemented by a processor in the data cleaning device; and the first sending unit 605 can be implemented by a communication interface in the data cleaning device.

[0131] In order to implement the method on the client side of the embodiment of the present application, the embodiment of the present application also provides a data cleaning device, which is arranged on the client, such as Figure 7As shown, the device comprises:

[0132] The second sending unit 701 is used to send a data cleaning request to the cloud platform, and send the to-be-cleaned data corresponding to the data cleaning request to the cloud platform, so that the cloud platform performs data cleaning on the to-be-cleaned data, and monitors the data cleaning process, and the network where the server corresponding to the client is located is different from the network where the server corresponding to the cloud platform is located;

[0133] The receiving unit 702 is used to receive the data cleaning result or notification information sent by the cloud platform, and the notification information indicates that the data cleaning failed; wherein, the data cleaning result is sent when the cloud platform monitors the data cleaning result within a first time period and the data cleaning result meets a first condition; the notification information is sent when the cloud platform does not monitor the data cleaning result within the first time period, or the notification information is sent when the cloud platform monitors the data cleaning result within the first time period and the data cleaning result does not meet the first condition; the first condition indicates that the number of data items in the data cleaning result is the same as the number of data items in the data to be cleaned.

[0134] In one embodiment, if Figure 7 As shown, the device may further include an encryption unit 703, which is used to encrypt the data to be cleaned in a first manner, the first manner is symmetrical with the second manner of the cloud platform, and the second manner is used to decrypt the encrypted data to be cleaned;

[0135] Correspondingly, the second sending unit 701 is also used to send the encrypted data to be cleaned to the cloud platform.

[0136] In actual application, the second sending unit 701 and the receiving unit 702 can be implemented by a communication interface in the data cleaning device; the encryption unit 703 can be implemented by a processor in the data cleaning device.

[0137] It should be noted that: the data cleaning device provided in the above embodiment only uses the division of the above program modules as an example when performing data cleaning. In actual applications, the above processing can be assigned to different program modules as needed, that is, the internal structure of the device is divided into different program modules to complete all or part of the processing described above. In addition, the data cleaning device provided in the above embodiment and the data cleaning method embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0138] Based on the hardware implementation of the above program modules, and in order to implement the method of the cloud platform side of the embodiment of the present application, the embodiment of the present application also provides a cloud platform, such as Figure 8As shown, the cloud platform 800 includes:

[0139] The first communication interface 801 is capable of exchanging information with the client;

[0140] A first processor 802 is connected to the first communication interface 801 to implement information interaction with the client, and is used to execute the method provided by one or more technical solutions on the cloud platform side when running a computer program;

[0141] A first memory 803 , in which the computer program is stored.

[0142] Specifically, the first processor 802 is configured to:

[0143] Obtaining a data cleaning request from a client through the first communication interface 801, and obtaining the to-be-cleaned data corresponding to the data cleaning request through the first communication interface 801, wherein the network where the server corresponding to the client is located is different from the network where the server corresponding to the cloud platform 800 is located;

[0144] The data to be cleaned is cleaned, and the process of data cleaning is monitored; wherein, when the data cleaning result is monitored within a first time period and the data cleaning result meets a first condition, the data cleaning result is sent to the client through the first communication interface 801; when the data cleaning result is not monitored within the first time period, or when the data cleaning result is monitored within the first time period and the data cleaning result does not meet the first condition, a notification message is sent to the client through the first communication interface 801, and the notification message indicates that the data cleaning has failed; the first condition indicates that the number of data items in the data cleaning result is the same as the number of data items in the data to be cleaned.

[0145] In one embodiment, the data to be cleaned acquired by the cloud platform 800 is data encrypted by the client using a first method, and the first processor 802 is further configured to:

[0146] Decrypting the acquired data to be cleaned using a second method, where the second method is symmetrical to the first method;

[0147] Perform data cleaning on the decrypted data to be cleaned.

[0148] In one embodiment, the first processor 802 is further configured to:

[0149] Splitting the task of cleaning the data to be cleaned into multiple subtasks, each subtask corresponding to a portion of the data to be cleaned;

[0150] Performing distributed parallel processing on the multiple subtasks to obtain the data cleaning result;

[0151] The data cleaning result is stored in a preset cache space.

[0152] In one embodiment, the first processor 802 is further configured to:

[0153] For each of the multiple subtasks, a preset data cleaning model is matched with a portion of the data to be cleaned corresponding to the subtask at a field level to obtain a partial data cleaning result corresponding to the subtask; wherein the preset data cleaning model is used to clean the data to be cleaned that meets a second condition, and the second condition indicates that the data to be cleaned contains sensitive data.

[0154] In one embodiment, the first processor 802 is further configured to:

[0155] Within the first time period, N queries are performed to determine whether the cache space stores the data cleaning result, each of the N queries is separated from the previous query by a second time period, the second time period is less than the first time period, and N is an integer greater than 1; wherein,

[0156] In the case that it is queried that the data cleaning result is stored in the cache space, it is determined that the data cleaning result is monitored within the first time period, and it is determined whether the data cleaning result meets the first condition.

[0157] In one embodiment, the first processor 802 is further configured to delete the data cleaning result from the cache space if the data cleaning result does not satisfy the first condition.

[0158] It should be noted that the specific processing process of the first processor 802 and the first communication interface 801 can be understood by referring to the above method, which will not be repeated here.

[0159] Of course, in actual application, the various components in the cloud platform 800 are coupled together through the bus system 804. It can be understood that the bus system 804 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 804 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clarity, Figure 8 Various buses are labeled as bus system 804 .

[0160] The first memory 803 in the embodiment of the present application is used to store various types of data to support the operation of the cloud platform 800. Examples of such data include: any computer program used to operate on the cloud platform 800.

[0161] The method disclosed in the above embodiment of the present application can be applied to the first processor 802, or implemented by the first processor 802. The first processor 802 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the first processor 802. The first processor 802 may be a general-purpose processor, a digital signal processor (DSP, Digital Signal Processor), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The first processor 802 can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor may be a microprocessor or any conventional processor, etc. In combination with the steps of the method disclosed in the embodiment of the present application, it can be directly embodied as a hardware decoding processor to execute, or it can be executed by a combination of hardware and software modules in the decoding processor. The software module may be located in a storage medium, which is located in the first memory 803, and the first processor 802 reads the information in the first memory 803 and completes the steps of the above method in combination with its hardware.

[0162] In an exemplary embodiment, the cloud platform 800 may be implemented by one or more application specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers (MCUs), microprocessors, or other electronic components to execute the aforementioned method.

[0163] Based on the hardware implementation of the above program modules, and in order to implement the method on the client side of the embodiment of the present application, the embodiment of the present application also provides a client, such as Fig. 9 As shown, the client 900 includes:

[0164] The second communication interface 901 is capable of exchanging information with the cloud platform;

[0165] A second processor 902 is connected to the second communication interface 901 to implement information interaction with the cloud platform, and is used to execute the method provided by one or more technical solutions on the client side when running the computer program;

[0166] A second memory 903 , on which the computer program is stored.

[0167] Specifically, the second communication interface 901 is used to

[0168] Sending a data cleaning request to the cloud platform, and sending the to-be-cleaned data corresponding to the data cleaning request to the cloud platform, so that the cloud platform cleans the to-be-cleaned data, and monitors the data cleaning process, wherein the network where the server corresponding to the client 900 is located is different from the network where the server corresponding to the cloud platform is located;

[0169] Receive a data cleaning result or notification information sent by the cloud platform, the notification information indicating that the data cleaning failed; wherein, the data cleaning result is sent when the cloud platform monitors the data cleaning result within a first time period and the data cleaning result meets a first condition; the notification information is sent when the cloud platform does not monitor the data cleaning result within the first time period, or the notification information is sent when the cloud platform monitors the data cleaning result within the first time period and the data cleaning result does not meet the first condition; the first condition indicates that the number of data items in the data cleaning result is the same as the number of data items in the data to be cleaned.

[0170] In one embodiment, the second processor 902 is used to encrypt the data to be cleaned in a first manner; the first manner is symmetrical to the second manner of the cloud platform, and the second manner is used to decrypt the encrypted data to be cleaned;

[0171] Correspondingly, the second communication interface 901 is also used to send the encrypted data to be cleaned to the cloud platform.

[0172] It should be noted that the specific processing process of the second communication interface 901 and the second processor 902 can be understood by referring to the above method, which will not be repeated here.

[0173] Of course, in actual application, the various components in the client 900 are coupled together through the bus system 904. It can be understood that the bus system 904 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 904 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clarity, Fig. 9 Various buses are labeled as bus system 904.

[0174] The second memory 903 in the embodiment of the present application is used to store various types of data to support the operation of the client 900. Examples of such data include: any computer program used to operate on the client 900.

[0175] The method disclosed in the above embodiment of the present application can be applied to the second processor 902, or implemented by the second processor 902. The second processor 902 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by an integrated logic circuit of the hardware in the second processor 902 or an instruction in the form of software. The second processor 902 may be a general-purpose processor, a DSP, or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The second processor 902 can implement or execute the methods, steps and logic block diagrams disclosed in the embodiments of the present application. A general-purpose processor may be a microprocessor or any conventional processor, etc. In combination with the steps of the method disclosed in the embodiment of the present application, it can be directly embodied as a hardware decoding processor to execute, or it can be executed by a combination of hardware and software modules in the decoding processor. The software module may be located in a storage medium, which is located in the second memory 903, and the second processor 902 reads the information in the second memory 903 and completes the steps of the above method in combination with its hardware.

[0176] In an exemplary embodiment, the client 900 may be implemented by one or more ASICs, DSPs, PLDs, CPLDs, FPGAs, general purpose processors, controllers, MCUs, Microprocessors, or other electronic components to perform the aforementioned methods.

[0177] It can be understood that the memory (first memory 803, second memory 903) of the embodiment of the present application can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a ferromagnetic random access memory, a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM); the magnetic surface memory can be a disk memory or a tape memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), synchronous static random access memory (SSRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DRRAM).The memories described in the embodiments of the present application are intended to include, but are not limited to, these and any other suitable types of memories.

[0178] In order to implement the method provided in the embodiment of the present application, the embodiment of the present application also provides a data cleaning system, such as Fig.10 As shown, the system includes: a cloud platform 1001 and a client 1002.

[0179] Here, it should be noted that the specific processing process of the cloud platform 1001 and the client 1002 has been described in detail above and will not be repeated here.

[0180] In an exemplary embodiment, the embodiment of the present application further provides a storage medium, namely a computer storage medium, specifically a computer-readable storage medium, for example, including a first memory 803 storing a computer program, and the above-mentioned computer program can be executed by the first processor 802 of the cloud platform 800 to complete the steps described in the aforementioned cloud platform side method. For another example, including a second memory 903 storing a computer program, the above-mentioned computer program can be executed by the second processor 902 of the client 900 to complete the steps described in the aforementioned client side method. The computer-readable storage medium can be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface storage, optical disk, or CD-ROM.

[0181] It should be noted that: "first", "second", etc. are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0182] In addition, the technical solutions described in the embodiments of the present application can be combined arbitrarily without conflict.

[0183] The above description is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application.

Claims

1. A data cleaning method, characterized in that: Applied to cloud platforms, including: Obtaining a data cleaning request from a client, and obtaining the to-be-cleaned data corresponding to the data cleaning request, wherein a network where a server corresponding to the client is located is different from a network where a server corresponding to the cloud platform is located; The data to be cleaned is cleaned, and the process of data cleaning is monitored; wherein, if the data cleaning result is monitored within a first time period and the data cleaning result meets a first condition, the data cleaning result is sent to the client; if the data cleaning result is not monitored within the first time period, or if the data cleaning result is monitored within the first time period and the data cleaning result does not meet the first condition, a notification message is sent to the client, and the notification message indicates that the data cleaning has failed; the first condition indicates that the number of data items in the data cleaning result is the same as the number of data items in the data to be cleaned.

2. The method according to claim 1, characterized in that The data to be cleaned acquired by the cloud platform is data encrypted by the client using the first method, and the data cleaning of the data to be cleaned includes: Decrypting the acquired data to be cleaned using a second method, where the second method is symmetrical to the first method; Perform data cleaning on the decrypted data to be cleaned.

3. The method according to claim 1, characterized in that The step of performing data cleaning on the data to be cleaned includes: Splitting the task of cleaning the data to be cleaned into multiple subtasks, each subtask corresponding to a portion of the data to be cleaned; Performing distributed parallel processing on the multiple subtasks to obtain the data cleaning result; The data cleaning result is stored in a preset cache space.

4. The method according to claim 3, characterized in that The distributed parallel processing of the multiple subtasks includes: For each of the multiple subtasks, a preset data cleaning model is matched with a portion of the data to be cleaned corresponding to the subtask at a field level to obtain a partial data cleaning result corresponding to the subtask; wherein the preset data cleaning model is used to clean the data to be cleaned that meets a second condition, and the second condition indicates that the data to be cleaned contains sensitive data.

5. The method according to claim 3, characterized in that: The monitoring of the data cleaning process includes: Within the first time period, N queries are performed to determine whether the cache space stores the data cleaning result, each of the N queries is separated from the previous query by a second time period, the second time period is less than the first time period, and N is an integer greater than 1; wherein, In the case that it is queried that the data cleaning result is stored in the cache space, it is determined that the data cleaning result is monitored within the first time period, and it is determined whether the data cleaning result meets the first condition.

6. The method according to claim 5, characterized in that The method further comprises: If the data cleaning result does not satisfy the first condition, the data cleaning result is deleted from the cache space.

7. A data cleaning method, characterized in that: Applied to the client, including: Sending a data cleaning request to the cloud platform, and sending the to-be-cleaned data corresponding to the data cleaning request to the cloud platform, so that the cloud platform cleans the to-be-cleaned data, and monitors the data cleaning process, wherein the network where the server corresponding to the client is located is different from the network where the server corresponding to the cloud platform is located; Receive a data cleaning result or notification information sent by the cloud platform, the notification information indicating that the data cleaning failed; wherein, the data cleaning result is sent when the cloud platform monitors the data cleaning result within a first time period and the data cleaning result meets a first condition; the notification information is sent when the cloud platform does not monitor the data cleaning result within the first time period, or the notification information is sent when the cloud platform monitors the data cleaning result within the first time period and the data cleaning result does not meet the first condition; the first condition indicates that the number of data items in the data cleaning result is the same as the number of data items in the data to be cleaned.

8. The method according to claim 7, characterized in that The sending the to-be-cleaned data corresponding to the data cleaning request to the cloud platform includes: The data to be cleaned is encrypted in a first manner, and the encrypted data to be cleaned is sent to the cloud platform; the first manner is symmetrical to the second manner of the cloud platform, and the second manner is used to decrypt the encrypted data to be cleaned.

9. A data cleaning device, characterized in that: Set up on the cloud platform, including: A first acquisition unit is used to acquire a data cleaning request from a client, wherein a network where a server corresponding to the client is located is different from a network where a server corresponding to the cloud platform is located; A second acquiring unit, configured to acquire the data to be cleaned corresponding to the data cleaning request; A cleaning unit, used for cleaning the data to be cleaned; A monitoring unit, used for monitoring the data cleaning process; A first sending unit is used to send the data cleaning result to the client when the data cleaning result is monitored within a first time period and the data cleaning result meets a first condition; send notification information to the client when the data cleaning result is not monitored within the first time period, or when the data cleaning result is monitored within the first time period and the data cleaning result does not meet the first condition, the notification information indicates that the data cleaning has failed; the first condition indicates that the number of data items in the data cleaning result is the same as the number of data items of the data to be cleaned.

10. A data cleaning device, characterized in that: Settings on the client include: A second sending unit is used to send a data cleaning request to the cloud platform, and send the to-be-cleaned data corresponding to the data cleaning request to the cloud platform, so that the cloud platform performs data cleaning on the to-be-cleaned data, and monitors the data cleaning process, wherein the network where the server corresponding to the client is located is different from the network where the server corresponding to the cloud platform is located; A receiving unit, used to receive a data cleaning result or notification information sent by the cloud platform, wherein the notification information indicates that the data cleaning has failed; wherein the data cleaning result is sent when the cloud platform monitors the data cleaning result within a first time period and the data cleaning result meets a first condition; the notification information is sent when the cloud platform does not monitor the data cleaning result within the first time period, or the notification information is sent when the cloud platform monitors the data cleaning result within the first time period and the data cleaning result does not meet the first condition; the first condition indicates that the number of data items in the data cleaning result is the same as the number of data items in the data to be cleaned.

11. A cloud platform, characterized in that: include: a first processor and a first memory for storing a computer program executable on the processor, Wherein, when the first processor is used to run the computer program, the steps of the method described in any one of claims 1 to 6 are executed.

12. A client, characterized in that: include: a second processor and a second memory for storing a computer program executable on the processor, Wherein, when the second processor is used to run the computer program, it executes the steps of the method according to claim 7 or 8.

13. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the computer program implements the steps of the method according to any one of claims 1 to 6, or implements the steps of the method according to claim 7 or 8.

Images