Data verification method and device in data synchronization stage, equipment and storage medium

By performing the data associative field verification, field verification and data logic verification during the data synchronization process, the problem of failure to effectively verify data during the data synchronization process in the prior art is solved, the accuracy and consistency of data is improved, and the reliability of data synchronization is enhanced.

CN120144569APending Publication Date: 2025-06-13CHINA UNITED NETWORK COMM GRP CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311708403.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-12-12
Publication Date
2025-06-13

AI Technical Summary

Technical Problem

The data verification method in the existing data synchronization stage fails to effectively verify the accuracy and completeness of the data during the synchronization process, resulting in erroneous or incomplete data being synchronized, affecting the accuracy and consistency of the data.

Method used

During the data synchronization process, by obtaining the data synchronization request sent by the upstream system, synchronous data is obtained from the upstream system's database, and the first target data is subject to correlation field verification, field verification, and data logic verification to ensure that the data has passed the verification before synchronization, and then it is stored in the synchronization database of the downstream system.

Benefits of technology

It improves the accuracy and consistency of data during the data synchronization stage, avoids the synchronization of incorrect data, enhances the reliability of data synchronization, and notifies operation and maintenance personnel in real time when verification fails, improving the quality of data maintenance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120144569A_ABST
    Figure CN120144569A_ABST
Patent Text Reader

Abstract

The invention provides a data verification method and device in a data synchronization stage, equipment and a storage medium. The method is applied to the technical field of computers, and comprises the following steps: acquiring a data synchronization request sent by an upstream system, acquiring synchronization data corresponding to the data synchronization request from a database of the upstream system according to the data synchronization request, acquiring first target data from the synchronization data, and performing associated field verification processing on the first target data, so as to obtain a data synchronization result; and when the first verification result indicates that the verification is successful, storing the synchronous data into a downstream system synchronous database. The accuracy of the synchronous data is improved, and when the verification fails, the operation and maintenance personnel are notified in real time, so that the maintenance quality of the synchronous data is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application belongs to the field of computer technology, and particularly relates to a data verification method, device, equipment, and storage medium during the data synchronization phase. Background Art

[0002] With the rapid development of computer technology, data synchronization technology plays a very important role in the computer field. Data synchronization ensures data consistency between different systems, thus supporting the business operations and decision-making of enterprises. With the growth of data volume and the change of business requirements, data synchronization technology is also constantly evolving.

[0003] In the existing environment, the data synchronization requirements between different systems have increased significantly, which makes the data synchronization processing work between different systems more and more frequent. Most of the existing data verification methods during the system data synchronization phase are to verify the data of a single platform.

[0004] However, the existing data verification methods during the data synchronization phase directly synchronize the data of upstream and downstream through API interfaces or data integration tools, and do not verify the accuracy and integrity of the data during the data synchronization process. Instead, they perform data verification for a single platform after synchronization, resulting in the synchronization of incorrect or incomplete data during the data synchronization process, leading to the defect that the synchronized data is inaccurate and cannot be used. Summary of the Invention

[0005] This application provides a data verification method, device, equipment, and storage medium during the data synchronization phase to improve the accuracy of data during the synchronization phase and make up for the deficiencies in data verification during the data synchronization phase in the prior art.

[0006] In a first aspect, this application provides a data verification method during the data synchronization phase, and the method includes:

[0007] Obtain a data synchronization request sent by an upstream system, and according to the data synchronization request, obtain synchronization data corresponding to the data synchronization request from the database of the upstream system;

[0008] Obtain first target data from the synchronization data, and perform associated field verification processing on the first target data to obtain a first verification result, where the first target data is data with an associated relationship;

[0009] When the first verification result indicates successful verification, store the synchronization data in the synchronization database of the downstream system.

[0010] Optionally, the obtaining first target data from the synchronization data includes:

[0011] Create a temporary synchronization table and perform field verification processing on the synchronization data. The field verification processing is used to indicate verification processing of the field type, field length, and value limitations of the synchronization data;

[0012] When the result of the field verification processing passes the verification, store the synchronization data in the temporary synchronization table and obtain the first target data from the synchronization data in the temporary synchronization table.

[0013] Optionally, storing the synchronization data in the downstream system synchronization database includes:

[0014] Obtain second target data from the synchronization data in the temporary synchronization table. The second target data is data with a key identifier;

[0015] Perform data logic verification processing on the second target data to obtain a second verification result. The data logic verification processing is used to indicate verification processing of the second target data according to the corresponding set logic rules;

[0016] When the second verification result indicates successful verification, store the synchronization data in the downstream system synchronization database.

[0017] Optionally, performing data logic verification processing on the second target data to obtain a second verification result includes:

[0018] Determine whether there is third target data corresponding to the second target data in the downstream system synchronization database;

[0019] If there is third target data corresponding to the second target data in the downstream system synchronization database, then determine whether the data logic of the third target data matches the data logic of the second target data;

[0020] If so, determine that the second verification result is successful verification;

[0021] If not, determine that the second verification result is failed verification.

[0022] Optionally, the method further includes: if the verification result indicates failed verification, write the verification result and the corresponding verification step identifier into the synchronization data reception log table.

[0023] Optionally, the method further includes: when the verification result indicates failed verification, trigger a timed detection warning task and obtain the synchronization failure log in the synchronization data reception log table;

[0024] Determine the verification step identifier corresponding to the synchronization failure according to the synchronization failure log;

[0025] Generate a synchronization failure message according to the verification step identifier, and send the synchronization failure message to the terminal device corresponding to the operation and maintenance personnel.

[0026] In a second aspect, the present application provides a data verification device during the data synchronization phase. The device includes:

[0027] An acquisition module, configured to acquire a data synchronization request sent by an upstream system, and according to the data synchronization request, acquire synchronization data corresponding to the data synchronization request from the database of the upstream system;

[0028] The acquisition module is further configured to acquire first target data from the synchronization data;

[0029] A processing module, configured to perform an associated field verification process on the first target data to obtain a first verification result, where the first target data is data with an association relationship;

[0030] The processing module is further configured to store the synchronization data in the downstream system synchronization database when the first verification result indicates successful verification.

[0031] Optionally, the processing module is configured to create a temporary synchronization table and perform a field verification process on the synchronization data, where the field verification process is used to indicate verification of the field type, field length, and value limitation of the synchronization data;

[0032] The processing module is further configured to store the synchronization data in the temporary synchronization table when the field verification process result is verification passed;

[0033] The acquisition module is configured to acquire the first target data from the synchronization data in the temporary synchronization table.

[0034] Optionally, the acquisition module is configured to acquire second target data from the synchronization data in the temporary synchronization table, where the second target data is data with a key identifier;

[0035] The processing module is configured to perform a data logic verification process on the second target data to obtain a second verification result, where the data logic verification process is used to indicate verification of the second target data according to corresponding set logic rules;

[0036] The processing module is further configured to store the synchronization data in the downstream system synchronization database when the second verification result indicates successful verification.

[0037] Optionally, the data verification device during the data synchronization phase further includes: a judgment module, a determination module;

[0038] The determination module is configured to determine whether there is a third target data corresponding to the second target data in the downstream system synchronization database;

[0039] The determination module is further configured to, when there is a third target data corresponding to the second target data in the downstream system synchronization database, determine whether the data logic of the third target data matches the data logic of the second target data;

[0040] The determination module is configured to determine that the second verification result is verification successful when the data logic of the third target data matches the data logic of the second target data;

[0041] The determination module is further configured to determine that the second verification result is verification failed when the data logic of the third target data does not match the data logic of the second target data.

[0042] Optionally, when the verification result indicates verification failure, the processing module is configured to write the verification result and the corresponding verification step identifier into the synchronization data reception log table.

[0043] Optionally, when the verification result indicates verification failure, the acquisition module is configured to trigger a timed detection warning task and acquire the synchronization failure logs in the synchronization data reception log table;

[0044] The determination module is configured to determine the verification step identifier corresponding to the synchronization failure according to the synchronization failure logs;

[0045] The processing module is configured to generate a synchronization failure message according to the verification step identifier and send the synchronization failure message to the terminal device corresponding to the operation and maintenance personnel.

[0046] In a third aspect, the present application provides a data verification device during data synchronization, including:

[0047] A memory;

[0048] A processor;

[0049] Wherein, the memory stores computer execution instructions;

[0050] The processor executes the computer execution instructions stored in the memory to implement the data verification method during data synchronization as described in the first aspect and various possible implementation manners of the first aspect.

[0051] In a fourth aspect, the present application provides a computer storage medium, on which a computer program is stored, and the computer program is executed by a processor to implement the data verification method during data synchronization as described in the first aspect and various possible implementation manners of the first aspect.

[0052] The present application provides a data verification method, apparatus, device, and storage medium during the data synchronization phase. The method obtains a data synchronization request sent by an upstream system, and according to the data synchronization request, obtains synchronization data corresponding to the data synchronization request from the database of the upstream system, obtains first target data from the synchronization data, and performs association field verification processing on the first target data to obtain a first verification result. When the first verification result indicates successful verification, the synchronization data is stored in the synchronization database of the downstream system. This improves the accuracy of the synchronized data, and when the verification fails, the operation and maintenance personnel are notified in real time, improving the quality of the synchronized data maintenance. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] The accompanying drawings herein are incorporated into the specification and constitute a part of this specification, showing embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application.

[0054] Figure 1 is a flowchart of the data verification method during the data synchronization phase provided by the present application Figure 1 ;

[0055] Figure 2 is a flowchart of the data verification method during the data synchronization phase provided by the present application Figure 2 ;

[0056] Figure 3 is a schematic structural diagram of the data verification apparatus during the data synchronization phase provided by the present application;

[0057] Figure 4 is a schematic structural diagram of the data verification device during the data synchronization phase provided by the present application.

[0058] Through the above-mentioned accompanying drawings, the clear embodiments of the present application have been shown, and there will be a more detailed description hereinafter. These drawings and text descriptions are not intended to limit the scope of the concept of the present application in any way, but to explain the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0059] To make the objectives, technical solutions, and advantages of the present application clearer, the technical solutions in the present application will be clearly and completely described below in conjunction with the accompanying drawings in the present application. Obviously, the described embodiments are some, but not all, of the embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without creative efforts shall fall within the protection scope of the present application.

[0060] In the description and claims of the present invention and the above-mentioned drawings, terms such as "first", "second", "third", "fourth", etc. (if any) are used to distinguish similar objects and do not necessarily describe a specific order or sequence. It should be understood that such data used can be interchanged under appropriate circumstances so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein.

[0061] In the embodiments of the present application, words such as "exemplary" or "for example" are used to represent examples, illustrations or explanations. Any embodiment or design solution described as "exemplary" or "for example" in the present application should not be construed as being more preferred or having more advantages than other embodiments or design solutions. Rather, the use of words such as "exemplary" or "for example" is intended to present relevant concepts in a specific manner.

[0062] With the rapid development of computer technology, the number of constructed systems has gradually increased, resulting in a blowout growth in the demand for data synchronization between different systems. This makes data synchronization technology play a very important role in the computer field. Data synchronization ensures data consistency between different systems and different departments. Data synchronization can quickly synchronize data to multiple systems, thus supporting the business operations and decision-making of enterprises.

[0063] In the existing environment, with the growth of data volume and the change of business requirements, data synchronization technology is also constantly evolving. Most of the existing data verification methods in the system data synchronization stage verify the data of a single platform.

[0064] However, the existing data verification methods in the data synchronization stage have the following defects:

[0065] 1) Low accuracy. Only the data of a single platform is verified after synchronization, and the accuracy and integrity of the data are not verified during the data synchronization process, resulting in low accuracy of the synchronized data.

[0066] 2) Low efficiency. By monitoring the database log for anomaly detection, when a synchronization anomaly occurs, it is impossible to know which piece of data is synchronously abnormal, resulting in low inspection efficiency.

[0067] In view of the above problems, the present application proposes a data verification method in the data synchronization stage. This method adds the verification of associated fields, fields, and key data logic of the synchronized data during the data synchronization process, thereby controlling the quality of the synchronized data. This method improves the accuracy of data in the data synchronization stage and avoids the defect of low accuracy caused by synchronizing incorrect data.

[0068] The following uses specific embodiments to elaborate in detail on the technical solution of the present application and how the technical solution of the present application solves the above technical problems. The following several specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0069] Figure 1 It is a flowchart showing the data verification method in the data synchronization stage provided by the embodiments of the present application Figure 1 As Figure 1 shown, the data verification method in the data synchronization stage provided by this embodiment includes:

[0070] S101. Obtain a data synchronization request sent by the upstream system, and according to the data synchronization request, obtain synchronization data corresponding to the data synchronization request from the database of the upstream system.

[0071] Among them, when the upstream system needs to synchronize its data to the downstream system, it will send a data synchronization request to the downstream system. The data synchronization request includes information such as the data information to be synchronized, the synchronization operation instruction, and the synchronization mode.

[0072] According to the content of the data synchronization request, perform a read operation on the database of the upstream system through the corresponding interface or protocol to obtain the data to be synchronized. The information included in the data synchronization request can help the downstream system accurately and reliably obtain the data to be synchronized by the upstream system, thereby realizing data synchronization.

[0073] S102. Obtain the first target data from the synchronization data, and perform associated field verification processing on the first target data to obtain a first verification result.

[0074] Among them, during the data synchronization process, a synchronization data set is obtained according to the data synchronization request. The first target data that needs to have an association relationship is found in the synchronization data set, and the associated data in the first target data is verified and compared for associated fields to determine the accuracy and consistency of the synchronization data. After performing the associated field verification processing on the first target data, a first verification result is obtained.

[0075] Exemplarily, a possible implementation method is given here. During the data synchronization process, field data such as the name of an employee, the pinyin of the name, and the employee's email are synchronized. There is an association relationship among the name of the employee, the pinyin of the name, and the employee's email, that is: the name of the employee corresponds to the pinyin of the name of the employee, and corresponds to the name of the employee's email. When the employee's name is Zhang San, verify whether the spelling of the pinyin of Zhang San's name is incorrect according to the association relationship, and verify whether the name of Zhang San's email is consistent with the employee's name and the spelling of the pinyin of the employee's name according to the association relationship.

[0076] S103. When the first verification result indicates successful verification, store the synchronization data in the synchronization database of the downstream system.

[0077] Among them, during the data synchronization process, when the data association field verification is successful, it indicates that the first target data is correct. The downstream system will store the synchronization data in its own system's synchronization database to ensure that the synchronization data with correct associated field verification can be completely and correctly obtained and used by the downstream system.

[0078] It can be understood that when the first verification result indicates failure, it means that the associated field verification fails, that is, the data verification fails. At this time, the synchronization data cannot be stored in the synchronization database of the downstream system.

[0079] This embodiment proposes a data verification method in the data synchronization stage. This method obtains a data synchronization request sent by the upstream system, and obtains synchronization data corresponding to the data synchronization request from the database of the upstream system; obtains the first target data from the synchronization data, and performs an associated field verification process on the first target data to obtain a first verification result. When the verification is successful, the synchronization data is stored in the synchronization database of the downstream system. This enables the verification of synchronization data during the data synchronization process, improving the accuracy of the synchronized data.

[0080] Figure 2 It is a flowchart of the data verification method in the data synchronization stage provided by the embodiment of the present application Figure 2 . This embodiment is based on Figure 1 On the basis of the embodiment, the data verification method in the data synchronization stage is described in detail. As Figure 2 shown, the data verification method in the data synchronization stage provided by this embodiment includes:

[0081] S201. Obtain a data synchronization request sent by the upstream system, and according to the data synchronization request, obtain synchronization data corresponding to the data synchronization request from the database of the upstream system.

[0082] Step S201 is the same as the above step S101 and will not be elaborated here.

[0083] S202. Create a temporary synchronization table and perform a field verification process on the synchronization data.

[0084] Among them, during the data synchronization process, in order to perform field verification processing on the synchronized data, the downstream system will create a temporary synchronization table, in which rules for verifying the field types, field lengths, and value limitations of the synchronized data are defined. Through these verification rules, it is possible to verify whether the field types, field lengths, and value limitations of the synchronized data conform to the verification rules. By performing field verification processing on the synchronized data, it can be ensured that the fields of the synchronized data meet the requirements, guaranteeing the integrity and accuracy of the synchronized data.

[0085] Exemplarily, a possible implementation method is given here. The human resources system of a certain company needs to synchronize candidate data from the recruitment system. During the data synchronization process, the recruitment system sends the personal information of candidates to the human resources system in tabular form. After receiving the data, the human resources system will first create a synchronization data table and perform field verification processing on the personal information of the synchronized candidates.

[0086] Read the synchronized data in the temporary synchronization row by row and verify each row of data according to the verification rules. For example: if the gender field of the person is marked as int type, then the human resources system will convert the gender data where 1 represents male and 2 represents female into an integer type and store it in the system as an integer type; if the home address field of the person is marked as varchar type, the human resources system will store the address information as a string type; if the name field of the candidate is a string type, the length should not exceed 50 characters; if the age field requires an integer type, the value range must be an integer for a valid input.

[0087] If the field information in the synchronized data does not meet the specified field type, length, or value limitation requirements, it will be marked as verification failed and the corresponding exception handling process in step S209 will be executed.

[0088] S203. Store the synchronized data into the temporary synchronization table and obtain the first target data from the synchronized data in the temporary synchronization table.

[0089] Among them, when the result of the field verification processing is verification passed, store the synchronized data into the temporary synchronization table and obtain the first target data from the synchronized data in the temporary synchronization table.

[0090] S204. Perform associated field verification processing on the first target data to obtain the first verification result.

[0091] Step S204 is the same as step S102 above and will not be elaborated here.

[0092] S205. Obtain the second target data from the synchronized data in the temporary synchronization table.

[0093] Among them, when the first verification result indicates successful verification, the downstream system extracts the data with the key identifier from the synchronized data in the temporary synchronization table as the second target data.

[0094] S206. Determine whether there is a third target data corresponding to the second target data in the downstream system synchronization database. If so, execute step S207; if not, execute step S208.

[0095] Among them, during the data synchronization process, after the downstream system obtains the second target data, it needs to match the existing data in the downstream database and determine whether there is a third target data corresponding to the second target data in the downstream system synchronization database. If it exists, execute step S207; if it does not exist, execute step S208.

[0096] By determining whether there is a third target data corresponding to the second target data in the downstream system synchronization database, duplicate records and duplicate synchronization data can be avoided, improving data stability and accuracy. This can effectively prevent problems caused by data errors and data duplication, and ensure the reliability of data synchronization.

[0097] Exemplarily, a possible implementation method is given here. Extract the key identifier data in the temporary synchronization table as the second target data, for example: person name A, person mobile phone number B, person email C.

[0098] Determine whether there is a third target data corresponding to the second target data in the synchronization database of the downstream system. The third target data corresponding to the second target data refers to: key identifier data such as person name A, person mobile phone number B, and person email C.

[0099] If there is a third target data corresponding to the second target data, it indicates that the key identifier information also exists in the database of the downstream system.

[0100] S207. Determine whether the data logic of the third target data matches the data logic of the second target data. If so, execute step S208; if not, execute step S209.

[0101] Among them, during the data synchronization process, the third target data in the downstream system needs to be verified whether its data logic matches that of the second target data. By comparing with the synchronization database of the downstream system, verify whether the data is repeated, verify whether the organization attribution code exists in the organization library, verify whether the level corresponding to the personnel position code conforms to the set type in the permission table, etc.

[0102] By determining whether the data logic of the third target data matches that of the second target data, the accuracy and integrity of the data can be ensured. This helps the downstream system detect and filter out data that does not meet the requirements, effectively reducing the impact of incorrect or incomplete data and ensuring the normal progress of the data synchronization process.

[0103] Exemplarily, a possible implementation is given here. The downstream system will compare with its own database to ensure that there are no duplicate records in the synchronized data. For example: if there is already employee information with the same work number, then check whether the organization affiliation code of the employee corresponding to the work number exists in the organization library in the third target data to ensure the correctness of the organization affiliation code. If the organization affiliation code does not exist or is filled in incorrectly, a verification failure will be prompted.

[0104] The downstream system will compare the personnel position code in the synchronized employee information with the corresponding permission table settings to ensure that the level corresponding to the position code meets the settings. If it does not meet the settings, a verification failure will be prompted.

[0105] S208. Store the synchronized data in the downstream system synchronization database.

[0106] S209. Write the verification result and the corresponding verification step identifier into the synchronization data reception log table.

[0107] Among them, in the case of verification failure in step S202, step S204, and step S207, the verification failure result and the corresponding verification step identifier are written into the synchronization data acceptance log table. The verification step identifier is intended to illustrate which verification step fails to verify the synchronized data during the data synchronization process and the reason for the data synchronization failure.

[0108] S210. Generate a synchronization failure message and send the synchronization failure message to the corresponding terminal device of the operation and maintenance personnel.

[0109] Among them, when a data synchronization failure occurs, a synchronization failure message containing detailed failure information is generated. The synchronization failure message includes the failed data content, the verification step identifier, and the failure reason, etc.

[0110] According to the work requirements of the operation and maintenance personnel, determine which terminal device of the operation and maintenance personnel the synchronization failure message needs to be sent to. For example, it can be a server desktop computer, a personal computer, or a mobile device such as a mobile phone or a tablet that the operation and maintenance personnel are using. So that the operation and maintenance personnel can quickly understand and handle the problem.

[0111] This embodiment proposes a data verification method during the data synchronization phase. This method performs associated field verification, field verification, and critical data logic verification on the synchronization data obtained from the upstream system during the data synchronization phase, thereby improving the accuracy of the synchronization data, avoiding the defect of data errors in the downstream system caused by directly synchronizing un-verified incorrect data, and generating a synchronization failure message when the verification fails, and sending the synchronization failure message to the operation and maintenance personnel in a timely manner, so that the operation and maintenance personnel can troubleshoot problems in a timely manner and improve the efficiency of data synchronization.

[0112] Figure 3 It is a structural schematic diagram of the data verification device during the data synchronization phase provided by this application. As Figure 3 shown, the data verification device 300 during the data synchronization phase provided by this embodiment includes:

[0113] An acquisition module 301, configured to acquire a data synchronization request sent by the upstream system, and according to the data synchronization request, acquire synchronization data corresponding to the data synchronization request from the database of the upstream system;

[0114] The acquisition module 301 is further configured to acquire first target data from the synchronization data;

[0115] A processing module 302, configured to perform associated field verification processing on the first target data to obtain a first verification result, where the first target data is data with an associated relationship;

[0116] The processing module 302 is further configured to store the synchronization data in the downstream system synchronization database when the first verification result indicates successful verification.

[0117] Optionally, the processing module 302 is configured to create a temporary synchronization table and perform field verification processing on the synchronization data, and the field verification processing is used to indicate verification processing on the field type, field length, and value limitation of the synchronization data;

[0118] The processing module 302 is further configured to store the synchronization data in the temporary synchronization table when the field verification processing result is verification passed;

[0119] The acquisition module 301 is configured to acquire the first target data from the synchronization data in the temporary synchronization table.

[0120] Optionally, the acquisition module 301 is configured to acquire second target data from the synchronization data in the temporary synchronization table, where the second target data is data with a critical identifier;

[0121] The processing module 302 is configured to perform data logic verification processing on the second target data to obtain a second verification result, where the data logic verification processing is used to indicate that the second target data is verified according to corresponding set logic rules;

[0122] The processing module 302 is further configured to store the synchronization data in the downstream system synchronization database when the second verification result indicates successful verification.

[0123] Optionally, the data verification device in the data synchronization stage further includes: a judgment module 303 and a determination module 304;

[0124] The judgment module 303 is configured to judge whether there is third target data corresponding to the second target data in the downstream system synchronization database;

[0125] The judgment module 303 is further configured to judge whether the data logic of the third target data matches the data logic of the second target data when there is third target data corresponding to the second target data in the downstream system synchronization database;

[0126] The determination module 304 is configured to determine that the second verification result is successful verification when the data logic of the third target data matches the data logic of the second target data;

[0127] The determination module 304 is further configured to determine that the second verification result is failed verification when the data logic of the third target data does not match the data logic of the second target data.

[0128] Optionally, when the verification result indicates failed verification, the processing module 302 is configured to write the verification result and the corresponding verification step identifier into the synchronization data reception log table.

[0129] Optionally, when the verification result indicates failed verification, the acquisition module 301 is configured to trigger a timed detection warning task and acquire the synchronization failure log in the synchronization data reception log table;

[0130] The determination module 304 is configured to determine the verification step identifier corresponding to the synchronization failure according to the synchronization failure log;

[0131] The processing module 302 is configured to generate a synchronization failure message according to the verification step identifier and send the synchronization failure message to the terminal device corresponding to the operation and maintenance personnel.

[0132] Figure 4 It is a schematic structural diagram of the data verification device in the data synchronization stage provided by this application. As Figure 4As shown in the figure, the present application provides a data verification device during the data synchronization phase. The data verification device 400 during the data synchronization phase includes: a receiver 401, a transmitter 402, a processor 403, and a memory 404.

[0133] The receiver 401 is configured to receive instructions and data;

[0134] The transmitter 402 is configured to transmit instructions and data;

[0135] The memory 404 is configured to store computer-executable instructions;

[0136] The processor 403 is configured to execute the computer-executable instructions stored in the memory 404 to implement each step performed by the data verification method during the data synchronization phase in the above embodiments. For specific details, reference can be made to the relevant descriptions in the data verification method embodiment during the data synchronization phase described above.

[0137] Optionally, the above-mentioned memory 404 can be either independent or integrated with the processor 403.

[0138] When the memory 404 is independently provided, the electronic device further includes a bus for connecting the memory 404 and the processor 403.

[0139] The present application also provides a computer storage medium. The computer storage medium stores computer-executable instructions. When the processor executes the computer-executable instructions, the data verification method during the data synchronization phase performed by the data verification device during the data synchronization phase as described above is implemented.

[0140] Those of ordinary skill in the art will understand that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices, can be implemented as software, firmware, hardware, and their appropriate combinations. In the hardware implementation, the division of the functional modules / units mentioned above does not necessarily correspond to the division of physical components; for example, one physical component can have multiple functions, or one function or step can be executed by several physical components in cooperation. Some or all of the physical components can be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or can be implemented as hardware, or can be implemented as an integrated circuit, such as an application-specific integrated circuit. Such software can be distributed on a computer-readable medium, which can include a computer storage medium (or non-transitory medium) and a communication medium (or transitory medium). As is well known to those of ordinary skill in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information, such as computer-readable instructions, data structures, program modules, or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, tapes, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, as is well known to those of ordinary skill in the art, communication media typically contains computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transmission mechanism, and can include any information delivery medium.

[0141] After considering the specification and practicing the invention disclosed herein, those skilled in the art will readily conceive of other embodiments of the present application. The present application is intended to cover any variations, uses, or adaptations of the present application that follow the general principles of the present application and include known common knowledge or conventional technical means in the technical field not disclosed in the present application. The specification and examples are only considered exemplary, and the true scope and spirit of the present application are pointed out by the following claims.

[0142] It should be understood that the present application is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present application is only limited by the appended claims.

Claims

1. A data verification method during the data synchronization phase, characterized in that, the method includes: Obtain a data synchronization request sent by an upstream system, and according to the data synchronization request, obtain synchronization data corresponding to the data synchronization request from the database of the upstream system; Obtain first target data from the synchronization data, and perform an associated field verification process on the first target data to obtain a first verification result, where the first target data is data with an association relationship; When the first verification result indicates successful verification, store the synchronization data in the synchronization database of the downstream system.

2. The method according to claim 1, characterized in that, the obtaining the first target data from the synchronization data includes: Create a temporary synchronization table, and perform a field verification process on the synchronization data, where the field verification process is used to indicate verification of the field type, field length, and value limitation of the synchronization data; When the result of the field verification process is verification passed, store the synchronization data in the temporary synchronization table, and obtain the first target data from the synchronization data in the temporary synchronization table.

3. The method according to claim 2, characterized in that, the storing the synchronization data in the synchronization database of the downstream system includes: Obtain second target data from the synchronization data in the temporary synchronization table, where the second target data is data with a key identifier; Perform a data logic verification process on the second target data to obtain a second verification result, where the data logic verification process is used to indicate verification of the second target data according to the corresponding set logic rules; When the second verification result indicates successful verification, store the synchronization data in the synchronization database of the downstream system.

4. The method according to claim 3, characterized in that, the performing a data logic verification process on the second target data to obtain a second verification result includes: Determine whether there is third target data corresponding to the second target data in the synchronization database of the downstream system; If there is third target data corresponding to the second target data in the synchronization database of the downstream system, then determine whether the data logic of the third target data matches the data logic of the second target data; If so, determine that the second verification result is successful verification; If not, determine that the second verification result is failed verification.

5. The method according to any one of claims 1-4, characterized in that, the method further includes: When the verification result indicates failed verification, write the verification result and the corresponding verification step identifier into the synchronization data reception log table.

6. The method according to claim 5, characterized in that, the method further includes: When the verification result indicates failed verification, trigger a timed detection warning task, and obtain the synchronization failure log in the synchronization data reception log table; According to the synchronization failure log, determine the verification step identifier corresponding to the synchronization failure; According to the verification step identifier, generate a synchronization failure message, and send the synchronization failure message to the terminal device corresponding to the operation and maintenance personnel.

7. A data verification device during the data synchronization phase, characterized in that, the device includes: An acquisition module, configured to acquire a data synchronization request sent by an upstream system, and according to the data synchronization request, acquire synchronization data corresponding to the data synchronization request from the database of the upstream system; The acquisition module is further configured to acquire first target data from the synchronization data; A processing module, configured to perform associated field verification processing on the first target data to obtain a first verification result, where the first target data is data with an association relationship; The processing module is further configured to store the synchronization data into the downstream system synchronization database when the first verification result indicates successful verification.

8. The device according to claim 7, characterized in that, the device further includes: A processing module, configured to create a temporary synchronization table and perform field verification processing on the synchronization data, where the field verification processing is used to indicate verification processing of the field type, field length, and value limitation of the synchronization data; The processing module is further configured to store the synchronization data into the temporary synchronization table when the field verification processing result is verification passed; An acquisition module, configured to acquire the first target data from the synchronization data in the temporary synchronization table.

9. A data verification device during the data synchronization phase, characterized in that, it includes: A memory; A processor; wherein, the memory stores computer execution instructions; The processor executes the computer execution instructions stored in the memory to implement the data verification method during the data synchronization phase according to any one of claims 1-6.

10. A computer storage medium, characterized in that, the computer storage medium stores computer execution instructions, and when the computer execution instructions are executed by a processor, they are used to implement the data verification method during the data synchronization phase according to any one of claims 1-6.