A data cleaning method, system, terminal, and computer-readable storage medium

By creating a data cleaning network model in data cleaning and allowing users to customize rules, the problems of large resource consumption and damaged data integrity in the prior art are solved, and an efficient and operational data cleaning process is achieved.

CN118673015BActive Publication Date: 2024-11-22深圳开鸿数字产业发展有限公司
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411161965.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-23
Publication Date
2024-11-22
Estimated Expiration
2044-08-23

AI Technical Summary

Technical Problem

Existing data cleaning technology resources are expensive, especially when processing large amounts of data, and may delete important data, resulting in the destruction of data integrity.

Method used

By creating multiple edge nodes, adding user-entered cleaning rules and generating data cleaning network models, analyzing and comparing data properties to implement data cleaning, allowing users to customize rules and update models for improved efficiency and user experience.

Benefits of technology

Improves the efficiency and user experience of data cleaning, ensures data integrity and accuracy, reduces resource consumption, and allows dynamic adjustment of the cleaning process to be based on demand.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118673015B_ABST
    Figure CN118673015B_ABST
Patent Text Reader

Abstract

The present invention discloses a data cleaning method, system, terminal and computer-readable storage medium, the method comprising: creating edge nodes, adding cleaning rules, connecting edge nodes to generate a data cleaning network model; analyzing process data input by a user and obtaining corresponding data attributes, and inputting the process data into the data cleaning network model, and outputting target data; analyzing the target data to obtain corresponding target data attributes, comparing the data attributes with the corresponding target data attributes, and obtaining data cleaning results. The present invention improves the operability of the data cleaning process by customizing cleaning rules and creating a data cleaning network model, and enables users to change the data cleaning network model according to needs, thereby improving the user experience and the efficiency of data cleaning.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of data cleaning, and in particular to a data cleaning method, system, terminal and computer-readable storage medium. Background Art

[0002] Data cleaning refers to the final step of discovering and correcting identifiable errors in data files, including checking data consistency, handling invalid values ​​and missing values, etc.

[0003] However, current data cleaning usually consumes a lot of time and energy, especially when dealing with large amounts of data or data of poor quality, the data cleaning efficiency is not high; and when the data cleaning process is too strict, some seemingly unimportant data may be deleted, resulting in the destruction of data integrity.

[0004] Therefore, the prior art still needs to be improved and developed. Summary of the invention

[0005] The main purpose of the present invention is to provide a data cleaning method, system, terminal and computer-readable storage medium, aiming to solve the problems in the prior art of large resource consumption during data cleaning and possible deletion of important data when cleaning a large amount of data, thereby destroying data integrity.

[0006] To achieve the above object, the present invention provides a data cleaning method, which comprises the following steps:

[0007] Creating multiple edge nodes, adding multiple cleaning rules input by the user to the multiple edge nodes, and connecting all the edge nodes to generate a data cleaning network model;

[0008] Acquire and analyze multiple process data input by the user to obtain corresponding data attributes, and input all the process data into the data cleaning network model for data cleaning, and output multiple target data;

[0009] All the target data are analyzed to obtain corresponding target data attributes, and all the target data attributes are compared with the corresponding data attributes to obtain a data cleaning result.

[0010] Optionally, the data cleaning method, wherein the step of creating multiple edge nodes, adding multiple cleaning rules input by a user to the multiple edge nodes, and connecting all the edge nodes to generate a data cleaning network model, specifically includes:

[0011] receiving multiple cleaning rules input by a user, creating multiple edge nodes according to the number of the cleaning rules, and adding all the cleaning rules to all the edge nodes respectively;

[0012] All the edge nodes are connected to build a data cleaning network model.

[0013] Optionally, the data cleaning method, wherein the step of connecting all the edge nodes to construct a data cleaning network model, further comprises:

[0014] After receiving the modification instruction input by the user, updating the preset number of cleaning rules according to the modification instruction to obtain the preset number of target cleaning rules;

[0015] Deleting the preset number of edge nodes corresponding to the cleaning rules, and creating the preset number of target edge nodes;

[0016] The preset number of target cleaning rules are added to all the target edge nodes respectively, and all the target edge nodes are connected to other edge nodes in the data cleaning network model to update the data cleaning network model.

[0017] Optionally, the data cleaning method, wherein the acquiring and analyzing of multiple process data input by the user to obtain corresponding data attributes, and inputting all the process data into the data cleaning network model for data cleaning, and outputting multiple target data, specifically includes:

[0018] Acquire multiple process data input by the user, analyze all the process data, and obtain corresponding data attributes;

[0019] All the process data are input into the data cleaning network model, and the data cleaning network model selects different cleaning rules to process the process data according to each data attribute, and outputs the corresponding target data.

[0020] Optionally, the data cleaning method, wherein all the process data are input into the data cleaning network model, the data cleaning network model selects different cleaning rules to process the process data according to each data attribute, and outputs the corresponding target data, and then further comprises:

[0021] Classifying all the cleaning rules to obtain a first number of the cleaning rules that need to filter the process data and a second number of the cleaning rules that do not need to filter the process data;

[0022] If the quantity of the target data does not match the second quantity, a first warning message is generated, and all the process data are re-input into the data cleaning network model for data cleaning.

[0023] Optionally, the data cleaning method, wherein the step of analyzing all the target data to obtain corresponding target data attributes, and comparing all the target data attributes with the corresponding data attributes to obtain a data cleaning result, specifically includes:

[0024] If the number of the target data matches the second number, analyzing all the target data to obtain corresponding target data attributes;

[0025] Compare all the data attributes with the target data attributes corresponding to the target data to obtain a data cleaning result.

[0026] Optionally, the data cleaning method, wherein the comparing all the data attributes with the target data attributes corresponding to the target data to obtain the data cleaning result, specifically includes:

[0027] Analyzing all the data attributes and the target data attribute corresponding to the target data to obtain a matching degree between each of the data attributes and the corresponding target data attribute;

[0028] If the matching degree is lower than a preset value, a second warning message is generated, and all the process data are re-input into the data cleaning network model for data cleaning.

[0029] In addition, to achieve the above object, the present invention also provides a data cleaning system, wherein the data cleaning system comprises:

[0030] A model creation module, used to create multiple edge nodes, add multiple cleaning rules input by the user to the multiple edge nodes, and connect all the edge nodes to generate a data cleaning network model;

[0031] A data cleaning module is used to obtain and analyze multiple process data input by the user to obtain corresponding data attributes, and input all the process data into the data cleaning network model for data cleaning, and output multiple target data;

[0032] The result analysis module is used to analyze all the target data to obtain corresponding target data attributes, and compare all the target data attributes with the corresponding data attributes to obtain data cleaning results.

[0033] In addition, to achieve the above-mentioned purpose, the present invention also provides a terminal, wherein the terminal includes: a memory, a processor, and a data cleaning program stored in the memory and executable on the processor, and when the data cleaning program is executed by the processor, the steps of the data cleaning method described above are implemented.

[0034] In addition, to achieve the above-mentioned purpose, the present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a data cleaning program, and when the data cleaning program is executed by a processor, the steps of the data cleaning method described above are implemented.

[0035] In the present invention, multiple edge nodes are created, multiple cleaning rules input by the user are added to the multiple edge nodes, and all the edge nodes are connected to generate a data cleaning network model; multiple process data input by the user are obtained and analyzed to obtain corresponding data attributes, and all the process data are input into the data cleaning network model for data cleaning, and multiple target data are output; all the target data are analyzed to obtain corresponding target data attributes, and all the target data attributes are compared with the corresponding data attributes to obtain data cleaning results. The present invention improves the operability of the data cleaning process by customizing cleaning rules and creating a data cleaning network model, and enables users to change the data cleaning network model according to needs, thereby improving the user experience and the efficiency of data cleaning. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 It is a flow chart of a preferred embodiment of the data cleaning method of the present invention;

[0037] Figure 2 It is a schematic diagram of parameter introduction of a preferred embodiment of the data cleaning method of the present invention;

[0038] Figure 3 It is a schematic diagram of node changes in a preferred embodiment of the data cleaning method of the present invention;

[0039] Figure 4 It is a schematic diagram of rule issuance of a preferred embodiment of the data cleaning method of the present invention;

[0040] Figure 5 It is a schematic diagram of rule modification of a preferred embodiment of the data cleaning method of the present invention;

[0041] Figure 6 It is a data filtering schematic diagram of a preferred embodiment of the data cleaning method of the present invention;

[0042] Figure 7 It is a schematic diagram of the principle of a preferred embodiment of the data cleaning system of the present invention;

[0043] Figure 8 Schematic diagram of the operating environment of a preferred embodiment of the terminal of the present invention. DETAILED DESCRIPTION

[0044] In order to make the purpose, technical solution and advantages of the present invention clearer and more specific, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0045] The data cleaning method described in the preferred embodiment of the present invention is as follows: Figure 1 As shown, the data cleaning method includes the following steps:

[0046] Step S10: create multiple edge nodes, add multiple cleaning rules input by the user to the multiple edge nodes, and connect all the edge nodes to generate a data cleaning network model.

[0047] Specifically, multiple cleaning rules input by a user are received, multiple edge nodes are created according to the number of the cleaning rules, and all the cleaning rules are added to all the edge nodes respectively; all the edge nodes are connected to build a data cleaning network model.

[0048] Each edge node created is used to add user-set cleaning rules, such as Figure 2 As shown, the cleaning rules set by the user can be set through parameter settings, and then all edge nodes are connected to build a data cleaning network model.

[0049] Furthermore, after receiving a modification instruction input by the user, a preset number of the cleaning rules are updated according to the modification instruction to obtain the preset number of target cleaning rules; the edge nodes corresponding to the preset number of the cleaning rules are deleted, and the preset number of target edge nodes are created; the preset number of the target cleaning rules are added to all the target edge nodes respectively, and all the target edge nodes are connected to other edge nodes in the data cleaning network model to update the data cleaning network model.

[0050] Among them, Figure 3As shown, corresponding modification instructions can be generated according to user needs to delete specific edge nodes in the data cleaning network model, or to re-add new edge nodes, that is, to delete some cleaning rules or add new cleaning rules, so as to improve the applicability of data cleaning, thereby improving the efficiency of data cleaning, meeting the diversified needs of users, and improving the user experience; and, after the data cleaning network model is updated, a viewing instruction can be entered on the controller side to check whether the data network model is updated successfully, and the command "tm_tool cleandata" is entered. If "ruleMatchList::cleandata_device: CLEAN2bdd1e199a0e456e974f67648fe9e788" is displayed, it means that the data cleaning network model is updated successfully, so as to prompt the user to proceed to the next data cleaning operation.

[0051] Step S20: Acquire and analyze multiple process data input by the user to obtain corresponding data attributes, and input all the process data into the data cleaning network model for data cleaning, and output multiple target data.

[0052] Specifically, multiple process data input by the user are obtained, all the process data are analyzed to obtain corresponding data attributes; all the process data are input into the data cleaning network model, and the data cleaning network model selects different cleaning rules to process the process data according to each data attribute, and outputs the corresponding target data.

[0053] Among them, the data attributes corresponding to the process data can be analyzed according to the process data input by the user, so as to help the user according to the needs of data cleaning, such as Figure 4 Shown and Figure 5 As shown, modifying the properties of the cleaning rules in the edge nodes can further meet the needs of users and customize the rules, thereby improving the applicability of the data cleaning network model for cleaning data and the operability of the data cleaning process.

[0054] Furthermore, all the cleaning rules are classified to obtain a first number of the cleaning rules that need to filter the process data and a second number of the cleaning rules that do not need to filter the process data; if the number of the target data does not match the second number, a first warning message is generated, and all the process data are re-input into the data cleaning network model for data cleaning.

[0055] According to the data attributes set in all cleaning rules, a first number of cleaning rules that need to perform data filtering and a second number of cleaning rules that do not need to perform data filtering can be determined. After all process data are input into the data cleaning network model, Figure 6 As shown, the data cleaning network model can complete the cleaning and filtering processing of the process data according to all the cleaning rules; and when the number of the filtered target data does not match the second number set by the user, it means that a failure has occurred in the cleaning process, and a second warning information is generated to prompt the user to check the set cleaning rules in time.

[0056] Step S30: Analyze all the target data to obtain corresponding target data attributes, and compare all the target data attributes with the corresponding data attributes to obtain a data cleaning result.

[0057] Specifically, if the quantity of the target data matches the second quantity, all the target data are analyzed to obtain corresponding target data attributes; all the data attributes are compared with the target data attributes corresponding to the target data to obtain a data cleaning result.

[0058] Among them, when there is no failure in the data filtering and cleaning process, it means that the number of target data after filtering and cleaning matches the second number set by the user. Then the target data attributes corresponding to all target data are analyzed and compared with the data attributes set in the corresponding second number of cleaning rules and the data attributes of the original process data to determine whether the data attributes corresponding to the three are consistent, and then generate the corresponding data cleaning rules. In this way, it can be more comprehensively judged whether the results of data cleaning are successful, thereby improving the integrity and accuracy of the cleaned target data.

[0059] Furthermore, all the data attributes and the target data attributes corresponding to the target data are analyzed to obtain a matching degree between each of the data attributes and the corresponding target data attributes; if the matching degree is lower than a preset value, a second warning message is generated, and all the process data are re-input into the data cleaning network model for data cleaning.

[0060] Among them, when it is determined that the matching degree between the data attributes of the target data after cleaning and filtering and the data attributes of the process data before cleaning and filtering is lower than the preset value, or the matching degree between the data attributes set in the corresponding second number of cleaning rules is lower than the preset value, it means that there is a problem with the parameter setting of the corresponding second number of cleaning rules, and a second warning information is generated to prompt the user to modify the cleaning rules in the corresponding edge node in time, which can further ensure the integrity and accuracy of the data.

[0061] The present invention improves the operability of the data cleaning process by customizing cleaning rules and creating a data cleaning network model, and enables users to modify the data cleaning network model according to needs, thereby improving user experience and efficiency of data cleaning.

[0062] Furthermore, if Figure 7 As shown, based on the above data cleaning method, the present invention also provides a data cleaning system, wherein the data cleaning system includes:

[0063] The model creation module 51 is used to create multiple edge nodes, add multiple cleaning rules input by the user to the multiple edge nodes, and connect all the edge nodes to generate a data cleaning network model;

[0064] The data cleaning module 52 is used to obtain and analyze multiple process data input by the user, obtain corresponding data attributes, and input all the process data into the data cleaning network model for data cleaning, and output multiple target data;

[0065] The result analysis module 53 is used to analyze all the target data to obtain corresponding target data attributes, and compare all the target data attributes with the corresponding data attributes to obtain data cleaning results.

[0066] Furthermore, if Figure 8 As shown, based on the above data cleaning method and system, the present invention also provides a terminal accordingly, and the terminal includes a processor 10, a memory 20 and a display 30. Figure 8 Only some components of the terminal are shown, but it should be understood that it is not required to implement all of the components shown, and more or fewer components may be implemented instead.

[0067] In some embodiments, the memory 20 may be an internal storage unit of the terminal, such as a hard disk or memory of the terminal. In other embodiments, the memory 20 may also be an external storage device of the terminal, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), etc. equipped on the terminal. Further, the memory 20 may also include both an internal storage unit of the terminal and an external storage device. The memory 20 is used to store application software and various types of data installed in the terminal, such as the program code of the installation terminal. The memory 20 may also be used to temporarily store data that has been output or is to be output. In one embodiment, a data cleaning program 40 is stored on the memory 20, and the data cleaning program 40 can be executed by the processor 10, thereby realizing the data cleaning method in the present application.

[0068] In some embodiments, the processor 10 may be a central processing unit (CPU), a microprocessor or other data processing chip, used to run the program code stored in the memory 20 or process data, such as executing the data cleaning method.

[0069] In some embodiments, the display 30 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch device, etc. The display 30 is used to display information on the terminal and to display a visual user interface. The components 10-30 of the terminal communicate with each other via a system bus.

[0070] In one embodiment, when the processor 10 executes the data cleaning program 40 in the memory 20, the following steps are implemented:

[0071] Creating multiple edge nodes, adding multiple cleaning rules input by the user to the multiple edge nodes, and connecting all the edge nodes to generate a data cleaning network model;

[0072] Acquire and analyze multiple process data input by the user to obtain corresponding data attributes, and input all the process data into the data cleaning network model for data cleaning, and output multiple target data;

[0073] All the target data are analyzed to obtain corresponding target data attributes, and all the target data attributes are compared with the corresponding data attributes to obtain a data cleaning result.

[0074] The step of creating multiple edge nodes, adding multiple cleaning rules input by a user to the multiple edge nodes, and connecting all the edge nodes to generate a data cleaning network model specifically includes:

[0075] receiving multiple cleaning rules input by a user, creating multiple edge nodes according to the number of the cleaning rules, and adding all the cleaning rules to all the edge nodes respectively;

[0076] All the edge nodes are connected to build a data cleaning network model.

[0077] The step of connecting all the edge nodes and building a data cleaning network model further includes:

[0078] After receiving the modification instruction input by the user, updating the preset number of cleaning rules according to the modification instruction to obtain the preset number of target cleaning rules;

[0079] Deleting the preset number of edge nodes corresponding to the cleaning rules, and creating the preset number of target edge nodes;

[0080] The preset number of target cleaning rules are added to all the target edge nodes respectively, and all the target edge nodes are connected to other edge nodes in the data cleaning network model to update the data cleaning network model.

[0081] The method of obtaining and analyzing multiple process data input by the user to obtain corresponding data attributes, and inputting all the process data into the data cleaning network model for data cleaning, and outputting multiple target data specifically includes:

[0082] Acquire multiple process data input by the user, analyze all the process data, and obtain corresponding data attributes;

[0083] All the process data are input into the data cleaning network model, and the data cleaning network model selects different cleaning rules to process the process data according to each data attribute, and outputs the corresponding target data.

[0084] Wherein, all the process data are input into the data cleaning network model, and the data cleaning network model selects different cleaning rules to process the process data according to each data attribute, and outputs the corresponding target data, and then further includes:

[0085] Classifying all the cleaning rules to obtain a first number of the cleaning rules that need to filter the process data and a second number of the cleaning rules that do not need to filter the process data;

[0086] If the quantity of the target data does not match the second quantity, a first warning message is generated, and all the process data are re-input into the data cleaning network model for data cleaning.

[0087] The step of analyzing all the target data to obtain corresponding target data attributes, and comparing all the target data attributes with the corresponding data attributes to obtain data cleaning results specifically includes:

[0088] If the number of the target data matches the second number, analyzing all the target data to obtain corresponding target data attributes;

[0089] Compare all the data attributes with the target data attributes corresponding to the target data to obtain a data cleaning result.

[0090] The step of comparing all the data attributes with the target data attributes corresponding to the target data to obtain a data cleaning result specifically includes:

[0091] Analyzing all the data attributes and the target data attribute corresponding to the target data to obtain a matching degree between each of the data attributes and the corresponding target data attribute;

[0092] If the matching degree is lower than a preset value, a second warning message is generated, and all the process data are re-input into the data cleaning network model for data cleaning.

[0093] The present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a data cleaning program, and when the data cleaning program is executed by a processor, the steps of the data cleaning method described above are implemented.

[0094] In summary, the present invention provides a data cleaning method and related equipment, the method comprising: creating multiple edge nodes, adding multiple cleaning rules input by a user to the multiple edge nodes, and connecting all the edge nodes to generate a data cleaning network model; obtaining multiple process data input by a user and analyzing them to obtain corresponding data attributes, and inputting all the process data into the data cleaning network model for data cleaning, and outputting multiple target data; analyzing all the target data to obtain corresponding target data attributes, and comparing all the target data attributes with the corresponding data attributes to obtain data cleaning results. The present invention improves the operability of the data cleaning process by customizing cleaning rules and creating a data cleaning network model, and enables users to change the data cleaning network model according to their needs, thereby improving the user experience and the efficiency of data cleaning.

[0095] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or terminal including the element.

[0096] Of course, those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware (such as a processor, a controller, etc.) through a computer program, and the program can be stored in a computer-readable storage medium that can be read by a computer, and the program can include the processes of the above-mentioned method embodiments when executed. The computer-readable storage medium can be a memory, a disk, an optical disk, etc.

[0097] It should be understood that the application of the present invention is not limited to the above examples. For ordinary technicians in this field, improvements or changes can be made based on the above description. All these improvements and changes should fall within the scope of protection of the claims attached to the present invention.

Claims

1. A data cleaning method, It is characterized in that The data cleaning method comprises: Creating multiple edge nodes, adding multiple cleaning rules input by the user to the multiple edge nodes, and connecting all the edge nodes to generate a data cleaning network model; The step of creating multiple edge nodes, adding multiple cleaning rules input by a user to the multiple edge nodes, and connecting all the edge nodes to generate a data cleaning network model specifically includes: receiving multiple cleaning rules input by a user, creating multiple edge nodes according to the number of the cleaning rules, and adding all the cleaning rules to all the edge nodes respectively; Connect all the edge nodes to build a data cleaning network model; After receiving the modification instruction input by the user, updating the preset number of cleaning rules according to the modification instruction to obtain the preset number of target cleaning rules; Deleting the preset number of edge nodes corresponding to the cleaning rules, and creating the preset number of target edge nodes; Adding the preset number of target cleaning rules to all the target edge nodes respectively, and connecting all the target edge nodes with other edge nodes in the data cleaning network model, and updating the data cleaning network model; After the data cleaning network model is updated, enter the view command on the controller to check whether the data network model is updated successfully; Acquire and analyze multiple process data input by the user to obtain corresponding data attributes, and input all the process data into the data cleaning network model for data cleaning, and output multiple target data; The method of acquiring and analyzing multiple process data input by the user to obtain corresponding data attributes, and inputting all the process data into the data cleaning network model for data cleaning, and outputting multiple target data, specifically includes: Acquire multiple process data input by the user, analyze all the process data, and obtain corresponding data attributes; Input all the process data into the data cleaning network model, and the data cleaning network model selects different cleaning rules to process the process data according to each data attribute, and outputs the corresponding target data; Classifying all the cleaning rules to obtain a first number of the cleaning rules that need to filter the process data and a second number of the cleaning rules that do not need to filter the process data; If the quantity of the target data does not match the second quantity, a first warning message is generated, and all the process data are re-input into the data cleaning network model for data cleaning; Analyze all the target data to obtain corresponding target data attributes, and compare all the target data attributes with the corresponding data attributes to obtain data cleaning results; The analyzing all the target data to obtain corresponding target data attributes, and comparing all the target data attributes with the corresponding data attributes to obtain data cleaning results, specifically includes: If the number of the target data matches the second number, analyzing all the target data to obtain corresponding target data attributes; Analyze the target data attributes corresponding to all target data, and compare them with the data attributes set in the corresponding second number of cleaning rules and the data attributes of the original process data, determine whether the data attributes corresponding to the three are consistent, and obtain the data cleaning result; Analyzing all the data attributes and the target data attribute corresponding to the target data to obtain a matching degree between each of the data attributes and the corresponding target data attribute; If the matching degree is lower than the preset value, a second warning message is generated to prompt the user to modify the cleaning rules in the corresponding edge node in time, and re-input all the process data into the data cleaning network model for data cleaning, and determine whether the data cleaning result is successful.

2. A data cleaning system, It is characterized in that The data cleaning system comprises: A model creation module, used to create multiple edge nodes, add multiple cleaning rules input by the user to the multiple edge nodes, and connect all the edge nodes to generate a data cleaning network model; The step of creating multiple edge nodes, adding multiple cleaning rules input by a user to the multiple edge nodes, and connecting all the edge nodes to generate a data cleaning network model specifically includes: receiving multiple cleaning rules input by a user, creating multiple edge nodes according to the number of the cleaning rules, and adding all the cleaning rules to all the edge nodes respectively; Connect all the edge nodes to build a data cleaning network model; After receiving the modification instruction input by the user, updating the preset number of cleaning rules according to the modification instruction to obtain the preset number of target cleaning rules; Deleting the preset number of edge nodes corresponding to the cleaning rules, and creating the preset number of target edge nodes; Adding the preset number of target cleaning rules to all the target edge nodes respectively, and connecting all the target edge nodes with other edge nodes in the data cleaning network model, and updating the data cleaning network model; After the data cleaning network model is updated, enter the view command on the controller to check whether the data network model is updated successfully; A data cleaning module is used to obtain and analyze multiple process data input by the user to obtain corresponding data attributes, and input all the process data into the data cleaning network model for data cleaning, and output multiple target data; The method of acquiring and analyzing multiple process data input by the user to obtain corresponding data attributes, and inputting all the process data into the data cleaning network model for data cleaning, and outputting multiple target data, specifically includes: Acquire multiple process data input by the user, analyze all the process data, and obtain corresponding data attributes; Input all the process data into the data cleaning network model, and the data cleaning network model selects different cleaning rules to process the process data according to each data attribute, and outputs the corresponding target data; Classifying all the cleaning rules to obtain a first number of the cleaning rules that need to filter the process data and a second number of the cleaning rules that do not need to filter the process data; If the quantity of the target data does not match the second quantity, a first warning message is generated, and all the process data are re-input into the data cleaning network model for data cleaning; A result analysis module, used to analyze all the target data, obtain corresponding target data attributes, and compare all the target data attributes with the corresponding data attributes to obtain data cleaning results; The analyzing all the target data to obtain corresponding target data attributes, and comparing all the target data attributes with the corresponding data attributes to obtain data cleaning results, specifically includes: If the number of the target data matches the second number, analyzing all the target data to obtain corresponding target data attributes; Analyze the target data attributes corresponding to all target data, and compare them with the data attributes set in the corresponding second number of cleaning rules and the data attributes of the original process data, determine whether the data attributes corresponding to the three are consistent, and obtain the data cleaning result; Analyzing all the data attributes and the target data attribute corresponding to the target data to obtain a matching degree between each of the data attributes and the corresponding target data attribute; If the matching degree is lower than the preset value, a second warning message is generated to prompt the user to modify the cleaning rules in the corresponding edge node in time, and re-input all the process data into the data cleaning network model for data cleaning, and determine whether the data cleaning result is successful.

3. A terminal, It is characterized in that The terminal comprises: a memory, a processor, and a data cleaning program stored in the memory and executable on the processor, wherein the data cleaning program implements the steps of the data cleaning method according to claim 1 when executed by the processor.

4. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a data cleaning program, and when the data cleaning program is executed by a processor, the steps of the data cleaning method according to claim 1 are implemented.