Data integrity checking system and method

Abstract

The invention discloses a data integrity checking system and method, and relates to the technical field of data checking, and the technical scheme is that the data integrity checking system comprises a data checking center module, the data checking center module comprises a data type and rule making module, and the data checking center module is in data connection with the data type and rule making module; the connection end of the data type and rule making module is provided with a verification algorithm selection module, the connection end of the verification algorithm selection module is provided with a verification management module, the connection end of the verification management module is provided with a verification process management module, and the connection end of the verification process management module is provided with a verification display module. The method has the beneficial effects of supporting integrity check on various types of data, instantly checking the data, avoiding data check delay, improving the accuracy of the data, ensuring the accuracy and stability of a check algorithm, avoiding false report and missing report, supporting self-defined check rules, adapting to demand changes of different business scenes and improving the check efficiency of the data.

Description

Technical Field

[0001] The present invention relates to the technical field of data verification, and in particular to a data integrity verification system and method. Background Art

[0002] Data quality inspection is an activity that observes and measures one or more characteristics of data and compares the results with specified standard data to determine whether the data is qualified.

[0003] The existing data cannot be verified in real time, resulting in data verification delays, affecting data accuracy. It does not support custom verification rules and cannot adapt to changing needs in different business scenarios, resulting in low data verification efficiency. Summary of the invention

[0004] To this end, the present invention provides a data integrity verification system and method to solve the problem that data cannot be verified in real time, resulting in data verification delays, affecting data accuracy, not supporting customized verification rules, and being unable to adapt to changes in demand in different business scenarios, resulting in low data verification efficiency.

[0005] In order to achieve the above-mentioned purpose, the present invention provides the following technical solutions: a data integrity verification system and method, including a data verification center module, the data verification center module including a data type and rule formulation module, the data verification center module is data-connected with the data type and rule formulation module, the data type and rule formulation module connection end is provided with a verification algorithm selection module, the verification algorithm selection module connection end is provided with a verification management module, the verification management module connection end is provided with a verification process management module, the verification process management module connection end is provided with a verification display module, the data verification center module connection end is respectively provided with an error handling feedback module and a performance testing optimization module, the data type and rule formulation module is data-connected with the verification algorithm selection module, the verification algorithm selection module is data-connected with the verification management module, the verification management module is data-connected with the verification process management module, the verification process management module is data-connected with the verification display module, and the data verification center module is data-connected with the error handling feedback module and the performance testing optimization module.

[0006] Preferably, the connection ends of the verification process management module are respectively provided with a process definition module, an automatic scheduling module and a process monitoring module, and the verification process management module is respectively data-connected with the process definition module, the automatic scheduling module and the process monitoring module.

[0007] Preferably, the connection end of the verification management module is provided with a data collection module, the connection end of the data collection module is provided with a preprocessing module, the connection end of the preprocessing module is provided with a data extraction module, the connection end of the data extraction module is provided with a rule matching module, the connection end of the rule matching module is provided with a verification execution module, the connection end of the verification execution module is provided with a verification result recording module, the verification management module is data-connected with the data collection module, the data collection module is data-connected with the preprocessing module, the preprocessing module is data-connected with the data extraction module, the data extraction module is data-connected with the rule matching module, the rule matching module is data-connected with the verification execution module, and the verification execution module is data-connected with the verification result recording module.

[0008] Preferably, the error handling feedback module comprises an error recognition module, an error classification module, a feedback mechanism module and an error recovery module, and the error handling feedback module is data-connected with the error recognition module, the error classification module, the feedback mechanism module and the error recovery module respectively.

[0009] Preferably, the performance test optimization module includes a benchmark test module, a bottleneck analysis module and a deployment maintenance module, and the performance test optimization module is data-connected with the benchmark test module, the bottleneck analysis module and the deployment maintenance module respectively.

[0010] Preferably, the verification display module includes a detection box, a control panel is provided inside the detection box, a placement cavity is opened inside the detection box, two telescopic shells are fixedly provided inside the placement cavity, side grooves are opened on one side of the two telescopic shells, one side of the two telescopic shells is connected with a rotating rod through a bearing, a display screen is fixed between the two rotating rods, a cavity is opened inside one of the telescopic shells, a short worm is connected inside the cavity through a bearing, a second worm wheel is provided on one side of the short worm, the second worm wheel is meshed with the short worm, the second worm wheel is fixedly connected to one of the rotating rods, a first knob is fixedly provided at one end of the short worm, and a long plate is fixed between the two telescopic shells.

[0011] Preferably, the placement cavity is connected to a connecting rod via a bearing, the connecting rod is externally fixed with a first worm gear, the connecting rod is externally fixed with a connecting plate, one side of the connecting plate is connected to a pulley via a bearing, the pulley is in contact with the long board, a baffle is fixedly provided at the bottom of the long board, the pulley is in contact with the baffle, the placement cavity is connected to a long worm via a bearing, the long worm is meshed with the first worm gear, and one end of the long worm is fixedly connected to a second knob.

[0012] Preferably, a handle is fixedly provided on one side of the detection box, and a box cover is connected to the other side of the detection box via a hinge.

[0013] Preferably, a side cavity is opened on one side of the detection box, a connecting line is arranged inside the side cavity, and one side of the detection box is connected to a side panel via a hinge.

[0014] A data integrity verification method, the specific steps are as follows:

[0015] S1. Clarify the data types supported by the inspection system, formulate specific verification rules based on the characteristics of the data types and business requirements, and select or customize specific verification algorithms based on business needs;

[0016] S2. Automatically or manually collect the data to be verified from various data sources, perform necessary operations such as formatting and cleaning on the data to meet the requirements of the verification algorithm, perform verification operations on the data according to the set verification rules and algorithms, and record the results of each verification, including success, failure and detailed error information;

[0017] S3. Clarify the sequence and dependencies of data collection, preprocessing, verification execution, and result recording, use timed tasks or event trigger mechanisms to automatically start the verification process, monitor the execution status of the verification process in real time, and promptly detect and handle abnormal situations;

[0018] S4. Identify data errors or anomalies in the verification process through verification results, classify errors, send error notifications and detailed error information to relevant personnel through emails, text messages, and system logs, provide data recovery suggestions and automatic repair functions, and minimize the impact of data errors on the business;

[0019] S5. Allow users to add, modify, and delete data sources, and provide a graphical interface so that users can easily configure verification rules and clearly display verification results.

[0020] The embodiments of the present invention have the following advantages:

[0021] 1. Support integrity verification of various types of data, with wide coverage, real-time data verification, avoiding data verification delays, improving data accuracy, ensuring the accuracy and stability of the verification algorithm, avoiding false positives and false negatives, supporting custom verification rules, adapting to changes in the needs of different business scenarios, and improving data verification efficiency;

[0022] 2. The connecting plate is driven to rotate by controlling the connecting rod. The pulley at one end of the connecting plate contacts the bottom of the long plate to push the long plate up, and the telescopic shell extends to control the display screen to rise. The second worm gear is driven to rotate by the short worm gear, and the second worm gear drives the rotating rod to rotate. The rotating rod drives the display screen to rotate, thereby controlling the display angle of the display screen to facilitate data display. After the box cover and the detection box body are closed, the display screen can be protected, which is convenient to use and highly practical. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the implementation methods of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for the implementation methods or the description of the prior art. Obviously, the drawings in the following description are only exemplary, and for ordinary technicians in this field, other implementation drawings can be derived from the provided drawings without creative work.

[0024] The structures, proportions, sizes, etc. illustrated in this specification are only used to match the contents disclosed in the specification so as to facilitate understanding and reading by persons familiar with the technology. They are not used to limit the conditions under which the present invention can be implemented, and therefore have no substantial technical significance. Any structural modification, change in proportion or adjustment of size shall still fall within the scope of the technical contents disclosed in the present invention without affecting the effects and purposes that can be achieved by the present invention.

[0025] Figure 1 A structural diagram of the data verification center module system provided by the present invention;

[0026] Figure 2 A diagram showing the structure of the verification management module system provided by the present invention;

[0027] Figure 3 A system structure diagram of the error handling feedback module provided by the present invention;

[0028] Figure 4 A system structure diagram of the performance test optimization module provided by the present invention;

[0029] Figure 5 A front view of the detection box provided by the present invention;

[0030] Figure 6 A side view of the detection box provided by the present invention;

[0031] Figure 7 A partial cross-sectional view of the telescopic housing provided by the present invention;

[0032] Figure 8 The present invention provides Figure 7 Enlarged view of the structure of part A in the middle.

[0033] In the figure: 1. Data verification center module; 2. Data type and rule formulation module; 3. Verification algorithm selection module; 4. Verification management module; 5. Verification process management module; 6. Verification display module; 7. Process definition module; 8. Automatic scheduling module; 9. Process monitoring module; 10. Error handling feedback module; 11. Performance test optimization module; 12. Data collection module; 13. Preprocessing module; 14. Data extraction module; 15. Rule matching module; 16. Verification execution module; 17. Verification result recording module; 18. Error identification module; 19. Error classification module; 20. Feedback mechanism module; 21. error recovery module; 22. benchmark module; 23. bottleneck analysis module; 24. deployment and maintenance module; 25. detection box; 26. handle; 27. control panel; 28. placement cavity; 29. ​​telescopic shell; 30. first knob; 31. box cover; 32. display screen; 33. rotating rod; 34. side panel; 35. side cavity; 36. connecting line; 37. long worm; 38. second knob; 39. connecting rod; 40. first worm gear; 41. connecting plate; 42. baffle; 43. second worm gear; 44. cavity; 45. short worm; 46. side groove; 47. long board; 48. pulley. DETAILED DESCRIPTION

[0034] The following is a description of the implementation of the present invention by specific embodiments. People familiar with the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0035] Refer to the attached Figure 1 -Attached Figure 8A data integrity verification system provided by the present invention comprises a data verification center module, the data verification center module comprises a data type and rule formulation module, the data verification center module is data-connected with the data type and rule formulation module, a verification algorithm selection module is provided at the connection end of the data type and rule formulation module, a verification management module is provided at the connection end of the verification algorithm selection module, a verification process management module is provided at the connection end of the verification management module, a verification display module is provided at the connection end of the verification process management module, an error handling feedback module and a performance test optimization module are provided at the connection end of the data verification center module, respectively, the data type and rule formulation module is data-connected with the verification algorithm selection module, the verification algorithm selection module is data-connected with the verification management module, the verification management module is data-connected with the verification process management module, the verification process management module is data-connected with the verification display module, and the data verification center module is data-connected with the error handling feedback module and the performance test optimization module respectively;

[0036] In this implementation scheme, the data types to be supported are clearly defined through the data type and rule formulation module, including text, images, videos, database records, etc. Specific verification rules are formulated according to the characteristics of the data type and business requirements, including the verification of character set and length for text data, the verification of file integrity hash value for images and videos, the verification of number of records and field integrity for database records, etc. The hash algorithm is selected through the verification algorithm selection module to generate data summaries to ensure that the data content has not been tampered with, and the selection is suitable for detecting errors in the data transmission process. Through digital signatures, combined with public key encryption technology, the authentication of data sources and the integrity of data are ensured. The verification display module allows users to add, modify, and delete data sources, and provides a graphical interface so that users can easily configure verification rules and clearly display verification results.

[0037] Among them, in order to achieve the purpose of verification process management, the present device is implemented by adopting the following technical solutions: the connection end of the verification process management module is respectively provided with a process definition module, an automatic scheduling module and a process monitoring module, and the verification process management module is respectively connected with the process definition module, the automatic scheduling module and the process monitoring module for data, and the sequence and dependency of data collection, preprocessing, verification execution and result recording are clarified through the process definition module, and the verification process is automatically started by using the timing task or event triggering mechanism through the automatic scheduling module, and the execution status of the verification process is monitored in real time through the process monitoring module, and abnormal situations are discovered and handled in time;

[0038] Among them, in order to achieve the purpose of verification management, the present device is implemented by the following technical solutions: the verification management module connection end is provided with a data collection module, the data collection module connection end is provided with a preprocessing module, the preprocessing module connection end is provided with a data extraction module, the data extraction module connection end is provided with a rule matching module, the rule matching module connection end is provided with a verification execution module, the verification execution module connection end is provided with a verification result recording module, the verification management module is data-connected with the data collection module, the data collection module is data-connected with the preprocessing module, the preprocessing module is data-connected with the data extraction module, the data extraction module is data-connected with the rule matching module The module data is connected, the rule matching module is connected with the verification execution module data, the verification execution module is connected with the verification result recording module data, the data collection module automatically or manually collects the data to be verified from each data source, the pre-processing module performs necessary formatting, cleaning and other operations on the data to meet the verification algorithm requirements, the data extraction module extracts the data to be verified from the data source, the rule matching module matches the corresponding verification rules according to the data type, the verification execution module performs the verification operation on the data according to the set verification rules and algorithms, and the verification result recording module records the results of each verification, including success, failure and detailed error information;

[0039] Among them, in order to achieve the purpose of error handling feedback, the present device is implemented by the following technical solutions: the error handling feedback module includes an error recognition module, an error classification module, a feedback mechanism module and an error recovery module, the error handling feedback module is respectively connected with the error recognition module, the error classification module, the feedback mechanism module and the error recovery module, and the error recognition module is used to identify data errors or abnormalities in the verification process through the verification results of the error recognition module. The error classification module classifies errors, such as data corruption, verification algorithm mismatch, and permission problems. The feedback mechanism module sends error notifications and detailed error information to relevant personnel through emails, text messages, system logs, etc. The error recovery module provides data recovery suggestions or automatic repair functions to minimize the impact of data errors on the business;

[0040] Among them, in order to achieve the purpose of performance test optimization, the present device is implemented by the following technical solutions: the performance test optimization module includes a benchmark test module, a bottleneck analysis module and a deployment maintenance module, and the performance test optimization module is respectively connected with the benchmark test module, the bottleneck analysis module and the deployment maintenance module. The benchmark test module is used to perform performance testing to evaluate indicators such as verification speed and resource consumption. The bottleneck analysis module is used to analyze the performance bottlenecks in the test results to find out the key factors affecting the performance. The deployment maintenance module is used to formulate a detailed deployment plan, including hardware configuration, network environment, and software version, and regularly back up system data and configuration to ensure rapid recovery in the event of a system failure.

[0041] Wherein, in order to achieve the purpose of angle adjustment, the device is implemented by the following technical solutions: the verification display module includes a detection box, a control panel is provided inside the detection box, a placement cavity is opened inside the detection box, two telescopic shells are fixedly arranged inside the placement cavity, side grooves are opened on one side of the two telescopic shells, a rotating rod is connected to one side of the two telescopic shells through bearings, a display screen is fixedly arranged between the two rotating rods, a cavity is opened inside one of the telescopic shells, a short worm is connected to the cavity through a bearing, a second worm gear is provided on one side of the short worm, the second worm gear is meshed with the short worm, the second worm gear is fixedly connected to one of the rotating rods, a first knob is fixedly provided at one end of the short worm, a long board is fixedly provided between the two telescopic shells, the telescopic shell can be unfolded, the first knob is turned, the first knob drives the short worm to rotate, the short worm drives the second worm gear to rotate, the second worm gear drives the rotating rod to rotate, and the rotating rod drives the display screen to rotate, thereby controlling the display angle of the display screen, facilitating the display of data, the control panel is convenient for manipulation, and the side groove facilitates the long board to slide in and out;

[0042] Wherein, in order to achieve the purpose of lifting, the device adopts the following technical solutions: the placement cavity is connected with a connecting rod through a bearing, the connecting rod is provided with a first worm gear on the external fixed sleeve, the connecting rod is provided with a connecting plate on the external fixed sleeve, a pulley is connected to one side of the connecting plate through a bearing, the pulley is in contact with the long board, a baffle is fixedly provided at the bottom of the long board, the pulley is in contact with the baffle, a long worm is connected with a bearing inside the placement cavity, the long worm is meshed with the first worm gear, one end of the long worm is fixedly connected with a second knob, the second knob is turned, the second knob drives the long worm to rotate, the long worm drives the first worm gear to rotate, the first worm gear drives the connecting rod to rotate, the connecting rod drives the connecting plate to rotate, the pulley at one end of the connecting plate contacts the bottom of the long board to push the long board up, the telescopic shell extends to control the display screen to rise, until the pulley contacts the baffle, the connecting plate can no longer rotate, and the telescopic shell reaches the expansion limit;

[0043] Among them, in order to achieve the purpose of convenient use, the present device is implemented by adopting the following technical solutions: a handle is fixedly provided on one side of the detection box, a box cover is connected to the other side of the detection box through a hinge, a side cavity is opened on one side of the detection box, a connecting wire is arranged inside the side cavity, a side panel is connected to one side of the detection box through a hinge, the side panel is opened to take out the connecting wire, the connecting wire can be connected to the data storage server, the display screen can be protected after the box cover and the detection box are closed, and the handle is convenient for lifting and use.

[0044] A data integrity verification method, the specific steps are as follows:

[0045] S1. Clarify the data types supported by the inspection system, formulate specific verification rules based on the characteristics of the data types and business requirements, and select or customize specific verification algorithms based on business needs;

[0046] S2. Automatically or manually collect the data to be verified from various data sources, perform necessary operations such as formatting and cleaning on the data to meet the requirements of the verification algorithm, perform verification operations on the data according to the set verification rules and algorithms, and record the results of each verification, including success, failure and detailed error information;

[0047] S3. Clarify the sequence and dependencies of data collection, preprocessing, verification execution, and result recording, use timed tasks or event trigger mechanisms to automatically start the verification process, monitor the execution status of the verification process in real time, and promptly detect and handle abnormal situations;

[0048] S4. Identify data errors or anomalies in the verification process through verification results, classify errors, send error notifications and detailed error information to relevant personnel through emails, text messages, and system logs, provide data recovery suggestions and automatic repair functions, and minimize the impact of data errors on the business;

[0049] S5. Allow users to add, modify, and delete data sources, and provide a graphical interface so that users can easily configure verification rules and clearly display verification results.

[0050] The use process of the present invention is as follows: when using the present invention, after opening the box cover 31, turn the second knob 38, the second knob 38 drives the long worm 37 to rotate, the long worm 37 drives the first worm gear 40 to rotate, the first worm gear 40 drives the connecting rod 39 to rotate, the connecting rod 39 drives the connecting plate 41 to rotate, the pulley 48 at one end of the connecting plate 41 contacts the bottom of the long plate 47 to push the long plate 47 upward, the telescopic housing 29 extends to control the display screen 32 to rise, until the pulley 48 contacts the baffle 42, the connecting plate 41 can no longer rotate, the telescopic housing 29 When the expansion limit is reached, the first knob 30 is rotated, the first knob 30 drives the short worm 45 to rotate, the short worm 45 drives the second worm gear 43 to rotate, the second worm gear 43 drives the rotating rod 33 to rotate, and the rotating rod 33 drives the display screen 32 to rotate, thereby controlling the display angle of the display screen 32 to facilitate the display of data. The control panel 27 is convenient for operation, the side panel 34 is opened to take out the connecting line 36, and the connecting line 36 can be connected to the data storage server. After the box cover 31 and the detection box body 25 are closed, the display screen 32 can be protected, and the handle 26 is convenient for lifting and use.

[0051] The above is only a preferred embodiment of the present invention. Any person skilled in the art may modify the present invention by using the above technical solution or modify it into an equivalent technical solution. Therefore, any simple modification or equivalent replacement made according to the technical solution of the present invention shall fall within the scope of protection claimed by the present invention.

Claims

1. A data integrity verification system, comprising a data verification center module (1), characterized in that: The data verification center module (1) comprises a data type and rule formulation module (2), the data verification center module (1) is data-connected with the data type and rule formulation module (2), a verification algorithm selection module (3) is provided at the connection end of the data type and rule formulation module (2), a verification management module (4) is provided at the connection end of the verification algorithm selection module (3), a verification process management module (5) is provided at the connection end of the verification management module (4), a verification display module (6) is provided at the connection end of the verification process management module (5), an error handling feedback module (10) and a performance test optimization module (11) are provided at the connection end of the data verification center module (1), the data type and rule formulation module (2) is data-connected with the verification algorithm selection module (3), the verification algorithm selection module (3) is data-connected with the verification management module (4), the verification management module (4) is data-connected with the verification process management module (5), the verification process management module (5) is data-connected with the verification display module (6), and the data verification center module (1) is data-connected with the error handling feedback module (10) and the performance test optimization module (11).

2. A data integrity verification system according to claim 1, characterized in that: The connection ends of the verification process management module (5) are respectively provided with a process definition module (7), an automatic scheduling module (8) and a process monitoring module (9), and the verification process management module (5) is respectively data-connected with the process definition module (7), the automatic scheduling module (8) and the process monitoring module (9).

3. A data integrity verification system according to claim 1, characterized in that: The connection end of the verification management module (4) is provided with a data collection module (12), the connection end of the data collection module (12) is provided with a preprocessing module (13), the connection end of the preprocessing module (13) is provided with a data extraction module (14), the connection end of the data extraction module (14) is provided with a rule matching module (15), the connection end of the rule matching module (15) is provided with a verification execution module (16), the connection end of the verification execution module (16) is provided with a verification result recording module (17), the verification management module (4) is data-connected with the data collection module (12), the data collection module (12) is data-connected with the preprocessing module (13), the preprocessing module (13) is data-connected with the data extraction module (14), the data extraction module (14) is data-connected with the rule matching module (15), the rule matching module (15) is data-connected with the verification execution module (16), and the verification execution module (16) is data-connected with the verification result recording module (17).

4. A data integrity verification system according to claim 1, characterized in that: The error processing feedback module (10) comprises an error recognition module (18), an error classification module (19), a feedback mechanism module (20) and an error recovery module (21), and the error processing feedback module (10) is respectively data-connected with the error recognition module (18), the error classification module (19), the feedback mechanism module (20) and the error recovery module (21).

5. A data integrity verification system according to claim 1, characterized in that: The performance test optimization module (11) comprises a benchmark test module (22), a bottleneck analysis module (23) and a deployment maintenance module (24); the performance test optimization module (11) is data-connected to the benchmark test module (22), the bottleneck analysis module (23) and the deployment maintenance module (24) respectively.

6. A data integrity verification system according to claim 1, characterized in that: The verification display module (6) comprises a detection box (25), a control panel (27) is arranged inside the detection box (25), a placement cavity (28) is provided inside the detection box (25), two telescopic shells (29) are fixedly arranged inside the placement cavity (28), a side groove (46) is provided on one side of the two telescopic shells (29), a rotating rod (33) is connected to one side of the two telescopic shells (29) via a bearing, and a display screen (32) is fixedly arranged between the two rotating rods (33), A cavity (44) is provided inside one of the telescopic shells (29), a short worm (45) is connected inside the cavity (44) via a bearing, a second worm wheel (43) is provided on one side of the short worm wheel (45), the second worm wheel (43) is meshed with the short worm wheel (45), the second worm wheel (43) is fixedly connected to one of the rotating rods (33), a first knob (30) is fixedly provided at one end of the short worm wheel (45), and a long plate (47) is fixedly provided between the two telescopic shells (29).

7. A data integrity verification system according to claim 6, characterized in that: The placement cavity (28) is connected to a connecting rod (39) via a bearing, a first worm gear (40) is fixedly sleeved outside the connecting rod (39), a connecting plate (41) is fixedly sleeved outside the connecting rod (39), a pulley (48) is connected to one side of the connecting plate (41) via a bearing, the pulley (48) is in contact with a long plate (47), a baffle (42) is fixedly provided at the bottom of the long plate (47), the pulley (48) is in contact with the baffle (42), a long worm (37) is connected to the placement cavity (28) via a bearing, the long worm (37) is meshed with the first worm gear (40), and a second knob (38) is fixedly connected to one end of the long worm (37).

8. A data integrity verification system according to claim 6, characterized in that: A handle (26) is fixedly provided on one side of the detection box (25), and a box cover (31) is connected to the other side of the detection box (25) via a hinge.

9. A data integrity verification system according to claim 6, characterized in that: A side cavity (35) is provided on one side of the detection box (25), a connecting line (36) is provided inside the side cavity (35), and one side of the detection box (25) is connected to a side plate (34) via a hinge.

10. A data integrity verification method, based on a data integrity verification system according to any one of claims 1 to 5, characterized in that: The specific steps are as follows: S1. Clarify the data types supported by the inspection system, formulate specific verification rules based on the characteristics of the data types and business requirements, and select or customize specific verification algorithms based on business needs; S2. Automatically or manually collect the data to be verified from various data sources, perform necessary operations such as formatting and cleaning on the data to meet the requirements of the verification algorithm, perform verification operations on the data according to the set verification rules and algorithms, and record the results of each verification, including success, failure and detailed error information; S3. Clarify the sequence and dependencies of data collection, preprocessing, verification execution, and result recording, use timed tasks or event trigger mechanisms to automatically start the verification process, monitor the execution status of the verification process in real time, and promptly detect and handle abnormal situations; S4. Identify data errors or anomalies in the verification process through verification results, classify errors, send error notifications and detailed error information to relevant personnel through emails, text messages, and system logs, provide data recovery suggestions and automatic repair functions, and minimize the impact of data errors on the business; S5. Allow users to add, modify, and delete data sources, and provide a graphical interface so that users can easily configure verification rules and clearly display verification results.

Images