Data comparison method, electronic device and computer program product

By generating a command database through configuration information and data comparison rules, data comparison is automatically performed, which solves the problems of slow manual verification speed and difficult to detect data deviations in the prior art, and realizes efficient and automatic data comparison.

CN119884186APending Publication Date: 2025-04-25KE COM (BEIJING) TECHNOLOGY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411933988.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-25
Publication Date
2025-04-25

AI Technical Summary

Technical Problem

In the prior art, data reconciliation between systems mainly relies on manual offline verification, which makes it slow and difficult to detect and solve data deviation problems in a timely manner.

Method used

The data system and comparison fields to be compared are determined through configuration information, a command database is generated based on the data comparison rules, an executable query command table is stored, and the data in the data system is compared through these command tables to determine the comparison result.

Benefits of technology

Automatic data comparison of orders of magnitude is realized, data verification efficiency is improved, data deviation problems are promptly discovered and solved, and errors and delays in manual verification are avoided.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119884186A_ABST
    Figure CN119884186A_ABST
Patent Text Reader

Abstract

The embodiment of the invention discloses a data comparison method, electronic equipment and a computer program product, and the method comprises the steps: determining a to-be-compared first data system, a to-be-compared second data system and a to-be-compared system comparison field according to received configuration information; determining a corresponding data comparison rule according to the first data system, the second data system and the system comparison field; determining a command database based on the data comparison rule; wherein the command database is used for storing an executable query command table; reading the query command table stored in the command database, comparing data received from the first data system and the second data system based on the query command table, and determining a data comparison result; according to the embodiment of the invention, large-order-of-magnitude automatic data comparison is realized, and the problems that the offline manual checking speed is low and the data deviation cannot be timely perceived are solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to data processing technology, and in particular to a data comparison method, an electronic device, and a computer program product. Background Art

[0002] Data verification between systems refers to the comparison of data between different systems to ensure the accuracy, completeness and consistency of the data. This process involves careful inspection and comparison of raw data, input data or processed data to ensure the authenticity and reliability of the data.

[0003] In many business areas, business data will be checked and processed according to business needs. For example, in the field of electronic transactions, the two parties to the transaction realize online transactions through a third-party payment system. The third-party payment system needs to reconcile with the bank system involved in the transaction through a reconciliation system. Reconciliation is to check the transaction information of the previous settlement cycle to confirm the consistency and correctness of the transaction information. Summary of the invention

[0004] Embodiments of the present disclosure provide a data comparison method, an electronic device, and a computer program product.

[0005] According to one aspect of an embodiment of the present disclosure, there is provided a data comparison method, comprising:

[0006] Determine, according to the received configuration information, a first data system, a second data system, and a system comparison field to be compared;

[0007] Determining corresponding data comparison rules according to the first data system, the second data system and the system comparison field;

[0008] Based on the data comparison rule, determine a command database; wherein the command database is used to store an executable query command table;

[0009] The query command table stored in the command database is read, and based on the query command table, data received from the first data system and the second data system are compared to determine a data comparison result.

[0010] Optionally, determining the command database based on the data comparison rule includes:

[0011] Generate a first query command and a second query command according to the data comparison rule; wherein the first query command corresponds to the first data system, and the second query command corresponds to the second data system;

[0012] Generate a first processing command for processing the non-regular data according to the processing operation of the non-regular data included in the data comparison rule;

[0013] Generate a second processing command for processing rule data according to the data difference processing operation included in the data comparison rule, the first query command and the second query command;

[0014] The command database is determined based on the first processing command and the second processing command.

[0015] Optionally, generating a second processing command for processing rule data according to the data difference processing operation included in the data comparison rule, the first query command and the second query command includes:

[0016] Determine a first subcommand according to the first query command, the second query command, and the same field comparison operation on the system comparison field in the data comparison rule;

[0017] Determine a second sub-command according to the first query command, the second query command, and different field comparison operations on the system comparison field in the data comparison rule;

[0018] Based on the first subcommand and the second subcommand, the second processing command is generated.

[0019] Optionally, reading the query command table in the command database, comparing the data received from the first data system and the second data system based on the query command table, and determining a data comparison result includes:

[0020] receiving first data to be compared in the first data system and second data to be compared in the second data system, and triggering a read instruction;

[0021] Read the query command table in the command database through the read instruction;

[0022] The first data and the second data are compared according to a plurality of processing commands included in the query command table to determine the data comparison result; the plurality of processing commands include at least one of the first processing command and / or at least one of the second processing command.

[0023] Optionally, the data comparison result includes a first comparison result and a second comparison result; the first comparison result corresponds to a first data system, and the second comparison result corresponds to a second data system;

[0024] The comparing the first data and the second data according to the multiple processing commands included in the query command table to determine the data comparison result includes:

[0025] Performing comparison processing on the first data and the second data based on the multiple processing commands, and updating a first difference result table corresponding to the first data system with the comparison processing result to obtain a first comparison result;

[0026] Based on the multiple processing commands, a comparison process is performed on the first data and the second data, and a second difference result table corresponding to the second data system is updated with the comparison process result to obtain a second comparison result.

[0027] Optionally, performing comparison processing on the first data and the second data based on the multiple processing commands, and updating a first difference result table corresponding to the first data system with the comparison processing result to obtain a first comparison result includes:

[0028] storing the comparison result data corresponding to at least one of the executed processing commands in the multiple processing commands into a first temporary difference table;

[0029] performing a comparison process on the first data and the second data based on at least one processing command that has not been executed among the multiple processing commands to obtain first difference data;

[0030] The first difference result table is updated based on the first difference data and the data in the first difference temporary table to obtain the first comparison result.

[0031] Optionally, performing comparison processing on the first data and the second data based on the multiple processing commands, and updating a second difference result table corresponding to the second data system with the comparison processing result to obtain a second comparison result includes:

[0032] storing the comparison result data corresponding to at least one of the executed processing commands in the plurality of processing commands into a second temporary difference table;

[0033] performing a comparison process on the first data and the second data based on at least one processing command that has not been executed among the multiple processing commands to obtain second difference data;

[0034] The second difference result table is updated based on the second difference data and the data in the second difference temporary table to obtain the second comparison result.

[0035] Optionally, determining a corresponding data comparison rule according to the first data system, the second data system and the system comparison field includes:

[0036] Based on the first data system, the second data system and the system comparison field, a preset rule library is queried to determine whether there is a corresponding preset comparison rule; wherein the preset rule library has a plurality of preset comparison rules pre-stored therein;

[0037] In response to the existence of a corresponding preset comparison rule, using the corresponding preset comparison rule as the data comparison rule;

[0038] In response to the absence of a corresponding preset comparison rule, rule configuration information is received through a configuration template to determine the data comparison rule.

[0039] Optionally, it also includes:

[0040] The data comparison results are displayed.

[0041] Optionally, presenting the data comparison result includes:

[0042] The data comparison results are displayed according to preset display rules.

[0043] According to another aspect of an embodiment of the present disclosure, there is provided a data comparison device, comprising:

[0044] An information configuration module, used to determine the first data system, the second data system and the system comparison field to be compared according to the received configuration information;

[0045] A rule determination module, used to determine a corresponding data comparison rule according to the first data system, the second data system and the system comparison field;

[0046] A rule storage module, used to determine a command database based on the data comparison rule; wherein the command database is used to store an executable query command table;

[0047] The data comparison module is used to read the query command table stored in the command database, compare the data received from the first data system and the second data system based on the query command table, and determine the data comparison result.

[0048] Optionally, the rule storage module includes:

[0049] A query command unit, configured to generate a first query command and a second query command according to the data comparison rule; wherein the first query command corresponds to the first data system, and the second query command corresponds to the second data system;

[0050] A first processing command unit, used for generating a first processing command for processing the non-regular data according to the processing operation of the non-regular data included in the data comparison rule;

[0051] A second processing command unit, configured to generate a second processing command for processing rule data according to the data difference processing operation included in the data comparison rule, the first query command and the second query command;

[0052] A command storage unit is used to determine the command database based on the first processing command and the second processing command.

[0053] Optionally, the second processing command unit is specifically used to determine a first sub-command based on the first query command, the second query command, and the same field comparison operation on the system comparison field in the data comparison rule; determine a second sub-command based on the first query command, the second query command, and the different field comparison operations on the system comparison field in the data comparison rule; and generate the second processing command based on the first sub-command and the second sub-command.

[0054] Optionally, the data comparison module includes:

[0055] A data receiving unit, configured to receive first data to be compared in the first data system and second data to be compared in the second data system, and trigger a read instruction;

[0056] A command reading unit, configured to read the query command table in the command database through the read instruction;

[0057] A comparison execution unit is used to perform a comparison on the first data and the second data according to a plurality of processing commands included in the query command table to determine the data comparison result; the plurality of processing commands include at least one of the first processing command and / or at least one of the second processing command.

[0058] Optionally, the data comparison result includes a first comparison result and a second comparison result; the first comparison result corresponds to a first data system, and the second comparison result corresponds to a second data system;

[0059] The comparison execution unit is specifically used to perform comparison processing on the first data and the second data based on the multiple processing commands, and update the first difference result table corresponding to the first data system with the comparison processing result to obtain a first comparison result; perform comparison processing on the first data and the second data based on the multiple processing commands, and update the second difference result table corresponding to the second data system with the comparison processing result to obtain a second comparison result.

[0060] Optionally, the comparison execution unit performs comparison processing on the first data and the second data based on the multiple processing commands, updates the first difference result table corresponding to the first data system with the comparison processing result, and obtains the first comparison result. The comparison execution unit is used to store the comparison result data corresponding to at least one of the multiple processing commands that has been executed into the first difference temporary table; performs comparison processing on the first data and the second data based on at least one of the multiple processing commands that has not been executed to obtain first difference data; and updates the first difference result table based on the first difference data and the data in the first difference temporary table to obtain the first comparison result.

[0061] Optionally, when the comparison execution unit performs comparison processing on the first data and the second data based on the multiple processing commands, updates the second difference result table corresponding to the second data system with the comparison processing result to obtain the second comparison result, the comparison execution unit is used to store the comparison result data corresponding to at least one processing command that has been executed among the multiple processing commands into a second difference temporary table; performs comparison processing on the first data and the second data based on at least one processing command that has not been executed among the multiple processing commands to obtain second difference data; and updates the second difference result table based on the second difference data and the data in the second difference temporary table to obtain the second comparison result.

[0062] Optionally, the rule determination module is specifically used to query a preset rule base based on the first data system, the second data system and the system comparison field to determine whether there is a corresponding preset comparison rule; wherein a plurality of preset comparison rules are pre-stored in the preset rule base; in response to the existence of a corresponding preset comparison rule, the corresponding preset comparison rule is used as the data comparison rule; in response to the absence of a corresponding preset comparison rule, rule configuration information is received through a configuration template to determine the data comparison rule.

[0063] Optionally, the device further comprises:

[0064] The data display module is used to display the data comparison results.

[0065] Optionally, the data display module is specifically used to display the data comparison result according to preset display rules.

[0066] According to another aspect of the embodiments of the present disclosure, there is provided an electronic device, including:

[0067] a memory for storing a computer program product;

[0068] The processor is used to execute the computer program product stored in the memory, and when the computer program product is executed, the data comparison method described in any of the above embodiments is implemented.

[0069] According to another aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, the data comparison method described in any of the above embodiments is implemented.

[0070] According to another aspect of the embodiments of the present disclosure, a computer program product is provided, including computer program instructions, which implement the data comparison method described in any of the above embodiments when executed by a processor.

[0071] Based on the data comparison method, electronic device and computer program product provided by the above embodiments of the present disclosure, the first data system, the second data system and the system comparison field to be compared are determined according to the received configuration information; the corresponding data comparison rules are determined according to the first data system, the second data system and the system comparison field; based on the data comparison rules, a command database is determined; wherein the command database is used to store executable query command tables; the query command table stored in the command database is read, and the data received from the first data system and the second data system are compared based on the query command table to determine the data comparison result; the embodiments of the present disclosure determine the corresponding data comparison rules by configuration, realize flexible configuration of data comparison rules, match data with data comparison rules, and realize data comparison of the first data system and the second data system based on the query command table, realize large-scale automatic data comparison, and solve the problems of slow offline manual verification and failure to detect data deviations in time.

[0072] The technical solution of the present disclosure is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0073] The accompanying drawings, which constitute a part of the specification, illustrate embodiments of the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0074] The present disclosure may be more clearly understood from the following detailed description with reference to the accompanying drawings, in which:

[0075] Figure 1 is a flow chart of a data comparison method provided by an exemplary embodiment of the present disclosure;

[0076] Figure 2 is an optional flow chart of determining a command database in a data comparison method provided by another exemplary embodiment of the present disclosure;

[0077] Figure 3 is an optional flow chart of determining a data comparison result in a data comparison method provided by another exemplary embodiment of the present disclosure;

[0078] Figure 4 is a structural schematic diagram of a data comparison device provided by an exemplary embodiment of the present disclosure;

[0079] Figure 5 A block diagram of an electronic device according to an embodiment of the present disclosure is illustrated. DETAILED DESCRIPTION

[0080] Below, the exemplary embodiments according to the present disclosure will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all the embodiments of the present disclosure, and it should be understood that the present disclosure is not limited to the exemplary embodiments described here.

[0081] It should be noted that the relative arrangement of components and steps, the numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.

[0082] Those skilled in the art can understand that the terms "first" and "second" in the embodiments of the present disclosure are only used to distinguish different steps, devices or modules, etc., and neither represent any specific technical meaning nor indicate the necessary logical order between them.

[0083] It should also be understood that in the embodiments of the present disclosure, “plurality” may refer to two or more than two, and “at least one” may refer to one, two, or more than two.

[0084] It should also be understood that any component, data or structure mentioned in the embodiments of the present disclosure can generally be understood as one or more, unless explicitly limited or otherwise indicated in the context.

[0085] In addition, the term "and / or" in this disclosure is only a description of the association relationship of associated objects, indicating that there may be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this disclosure generally indicates that the previous and next associated objects are in an "or" relationship. The data referred to in this disclosure may include unstructured data such as text, images, and videos, and may also be structured data.

[0086] It should also be understood that the description of the various embodiments in the present disclosure focuses on the differences between the various embodiments, and the same or similar aspects thereof can be referenced to each other, and for the sake of brevity, they will not be described one by one.

[0087] At the same time, it should be understood that for the convenience of description, the sizes of the various parts shown in the drawings are not drawn according to the actual proportional relationship.

[0088] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the present disclosure, its application, or uses.

[0089] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered as part of the specification.

[0090] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0091] The disclosed embodiments can be applied to electronic devices such as terminal devices, computer systems, servers, etc., which can operate with many other general or special computing system environments or configurations. Examples of well-known terminal devices, computing systems, environments and / or configurations suitable for use with electronic devices such as terminal devices, computer systems, servers, etc. include, but are not limited to: personal computer systems, server computer systems, thin clients, thick clients, handheld or laptop devices, microprocessor-based systems, set-top boxes, programmable consumer electronics, network personal computers, small computer systems, large computer systems, and distributed cloud computing technology environments including any of the above systems, etc.

[0092] Electronic devices such as terminal devices, computer systems, servers, etc. can be described in the general context of computer system executable instructions (such as program modules) executed by computer systems. Generally, program modules can include routines, programs, object programs, components, logic, data structures, etc., which perform specific tasks or implement specific abstract data types. Computer systems / servers can be implemented in a distributed cloud computing environment, where tasks are performed by remote processing devices linked through a communication network. In a distributed cloud computing environment, program modules can be located on local or remote computing system storage media including storage devices.

[0093] Application Overview

[0094] In the process of implementing the present disclosure, the inventors found that in the prior art, data verification between systems mostly adopts manual offline verification. However, due to the development and expansion of data systems, the number of existing systems is usually large, and the amount of data in some systems reaches billions. Manual verification is difficult and prone to errors, and data deviation problems cannot be discovered and solved in time.

[0095] Exemplary Methods

[0096] Figure 1FIG. 1 is a flow chart of a data comparison method provided by an exemplary embodiment of the present disclosure. This embodiment can be applied to electronic devices, such as Figure 1 As shown, the following steps are included:

[0097] Step 102: Determine the first data system, the second data system and the system comparison field to be compared according to the received configuration information.

[0098] Optionally, the disclosed embodiment provides an interactive interface for receiving configuration information, and the configuration information may include both systems that need to be compared. For example, the first data system and the second data system in the disclosed embodiment are the two comparison parties; in addition, there may be some data in the system that do not need to be compared, and the data that need to be compared is the system comparison field. The disclosed embodiment determines which data is used as the system comparison field through the configuration information; optionally, the first data system and the second data system in the disclosed embodiment may correspond to the same system comparison field or different system comparison fields; the specific comparison data content is not limited by configuring the system comparison field, but the name or position of the comparison data is determined, for example, the first data system is a house measurement system (used to record the broker's information on the house area, the size of each part, etc.), and the second data system is a house decoration system (used to determine the decoration quotation and other information based on the house area, the size of each part, etc.), the system comparison field corresponding to the first data system is configured as the house area, and the system comparison field corresponding to the second data system is configured as the floor decoration quotation. The disclosed embodiment can be applied to various different system comparisons, and any configuration information can be received through the interactive interface to achieve targeted data comparison.

[0099] Step 104: Determine corresponding data comparison rules according to the first data system, the second data system and the system comparison field.

[0100] In one embodiment, different system comparison fields correspond to different data comparison rules. For example, when the second data system is a statistical system, the data comparison rule may be to compare the sum of multiple fields in the first data system with a field in the second data system; for another example, for information such as images and texts, the system comparison field is directly compared with the data in the first data system and the second data system to determine whether there is a difference between the data; optionally, the data comparison rule may include any way of processing the data. Each data system may correspond to at least one data comparison rule; the data comparison rule corresponding to the first data system may be the same as or different from the data comparison rule corresponding to the second data system. The data comparison rule in this embodiment may be a pre-stored data comparison rule, or may be configured through configuration information received through an interactive interface.

[0101] Step 106, determining the command database based on the data comparison rule.

[0102] The command database is used to store executable query command tables. Optionally, the query command table can be a hive table. Since the hive table has a large data processing capability, it can store commands in large quantities, thereby improving the data processing efficiency of the disclosed embodiment. The disclosed embodiment can be applied to data verification with a data volume of hundreds of millions, and quickly determine data differences.

[0103] Optionally, the command database can be a relational database (for example, MySQL, etc.). Multiple executable commands can be generated based on data comparison rules. A query command table can be obtained by counting multiple executable commands. By storing the query command table in the command database, the executable commands in the query command table can be more conveniently obtained.

[0104] Step 108 , reading a query command table stored in a command database, performing a comparison on the data received from the first data system and the second data system based on the query command table, and determining a data comparison result.

[0105] In this embodiment, the query command table can be read by any reading method with faster reading speed or larger reading volume to improve data comparison efficiency. Optionally, parallel processing reading method can be used. For example, the query command table in the command database is read by spark task. Spark task has powerful data processing capability and can process a large amount of data at the same time, thereby improving data processing efficiency and realizing data processing at the billion level. Spark is a general parallel framework, and spark task is the basic unit of data parallel processing in spark. Each task is responsible for processing a data partition, and powerful data processing capability is provided through data parallel processing.

[0106] Based on the data comparison method provided by the above-mentioned embodiment of the present disclosure, according to the received configuration information, the first data system, the second data system and the system comparison field to be compared are determined; according to the first data system, the second data system and the system comparison field, the corresponding data comparison rules are determined; based on the data comparison rules, a command database is determined; wherein the command database includes an executable query command table; the query command table in the command database is read, and the data received from the first data system and the second data system are compared based on the query command table to determine the data comparison result; the embodiment of the present disclosure determines the corresponding data comparison rules through configuration, realizes flexible configuration of the data comparison rules, matches the data with the data comparison rules, and realizes data comparison of the first data system and the second data system based on the query command table, realizes large-scale automatic data comparison, and solves the problems of slow offline manual verification and failure to detect data deviations in time.

[0107] The disclosed embodiment is aimed at processing billions of data, and the verification is based on performance and function considerations. The storage of the data to be compared abandons the relational database (MySQL, Oracle, etc.) and Java data processing capabilities (loop nested comparison, list-map comparison, etc.) in the traditional method; the disclosed embodiment first proposes to use big data hive tables to store the data to be compared, and perform data comparison based on spark, based on the powerful data processing capabilities of hive tables and spark. The interaction between hive table calculation and dynamic verification rules is solved, and the sparkJar task of big data is used to integrate java logic, MySQL and hive, thereby improving data processing efficiency.

[0108] In some optional embodiments, step 104 may include:

[0109] A preset rule library is queried based on the first data system, the second data system and the system comparison field to determine whether there is a corresponding preset comparison rule.

[0110] Among them, a plurality of preset comparison rules are pre-stored in the preset rule library.

[0111] In response to the existence of a corresponding preset comparison rule, the corresponding preset comparison rule is used as a data comparison rule.

[0112] In response to the absence of a corresponding preset comparison rule, rule configuration information is received through a configuration template to determine a data comparison rule.

[0113] In this embodiment, in order to improve the efficiency of determining data comparison rules, the data comparison rules configured each time can be stored in a preset rule base. In addition, in order not to take up too much storage space, the preset rule base can be updated or cleaned up regularly. For example, when the time interval between the last use of a preset comparison rule in the preset rule base and the current time reaches a preset value (for example, one month, etc.), the preset comparison rule is deleted. Each preset comparison rule corresponds to a fixed comparison data system (for example, one preset comparison rule corresponds to the first data system and the second data system). After determining multiple preset comparison rules based on the first data system and the second data system, the preset comparison rule corresponding to the field can be determined based on the system comparison field, and the preset comparison rule of the secondary screening is used as the data comparison rule; and when there is no corresponding preset comparison rule, the corresponding data comparison rule can be configured for the current first data system, the second data system and the system comparison field according to the received rule configuration information. Optionally, in order to improve the configuration efficiency of the data comparison rule, a configuration template is provided in the interactive interface, and the configuration of the data comparison rule is realized by selecting in the configuration template. For example, the configuration template provides multiple different options for multiple types of data, and the user adjusts the matching template through the interactive interface to obtain data comparison rules that meet the needs. Optionally, the content involved in the data including: screening conditions, aggregation dimensions, field calculations, associated dimensions, comparison fields, comparison benchmarks, etc. is abstracted to obtain a configuration template, and the user's verification requirements are met through a flexible rule configuration template.

[0114] like Figure 2 As shown in the above Figure 1 Based on the illustrated embodiment, step 106 may include the following steps:

[0115] Step 1061: Generate a first query command and a second query command according to the data comparison rule.

[0116] The first query command corresponds to the first data system, and the second query command corresponds to the second data system.

[0117] Optionally, in some embodiments, the data to be compared are configured as A and B, and the data comparison rule is encoded as AB (it can be any processing rule, for example, whether A and B are the same, etc.); difference result tables are configured for the first data system and the second data system respectively: a first difference result table (hive A) and a second difference result table (hive B), hive A is used to store the comparison results corresponding to the first data system, and hive B is used to store the comparison results corresponding to the second data system.

[0118] In some optional embodiments, a first query command (queryA) and a second query command (queryB) are generated for the first data system and the second data system respectively according to the filtering conditions and aggregation conditions preset in the data comparison rules. Both the first query command and the second query command can be structured query language (Structured Query Language, SQL, abbreviated as SQL in the following embodiments of the present disclosure); the first query command represents the filtering processing instructions (generated based on the filtering conditions) and the aggregation processing instructions (generated based on the aggregation conditions) corresponding to the first data system. When the first query command is executed, the data obtained in the first data system and the second data system can be filtered and aggregated; the second query command represents the filtering processing instructions and the aggregation processing instructions corresponding to the second data system. When the second query command is executed, the data obtained in the first data system and the second data system can be filtered and aggregated.

[0119] Step 1062: Generate a first processing command for processing the non-regular data according to the processing operation of the non-regular data included in the data comparison rule.

[0120] Configure difference temporary tables for the first data system and the second data system respectively: the first data system corresponds to the first difference temporary table (hive Atemp), and the second data system corresponds to the second difference temporary table (hive B temp).

[0121] In this embodiment, the data comparison rules also include processing operations for irregular data, and the irregular data can be processed accordingly through these processing operations. In order to realize the executability of these processing operations, these processing operations are processed into first processing instructions in this embodiment. When the first processing instruction is executed, the irregular data in the first difference result table is stored in the first difference temporary table, and the irregular data in the second difference result table is stored in the second difference temporary table. In some optional examples, for example, the irregular AB data in the first difference result table is written into the SQL: temp_insert_diff_A of the tempAtemp table, and the irregular AB data in the second difference result table is written into the SQL: temp_insert_diff_B of the tempB temp table.

[0122] Step 1063: Generate a second processing command for processing the rule data according to the data difference processing operation, the first query command and the second query command included in the data comparison rule.

[0123] In some optional embodiments, the first subcommand is determined according to the first query command, the second query command, and the same field comparison operation of the system comparison field in the data comparison rule. Optionally, when the first subcommand is used for execution, the same fields in the two difference result tables are compared based on the data comparison rule; in some optional examples, for example, the first subcommand: inner_diff_A_B can be generated according to the aggregation dimension, the difference verification condition, the first query command (queryA) and the second query command (queryB), and optionally, the first subcommand can be a structured query language (StructuredQuery Language, SQL).

[0124] According to the first query command, the second query command, and the different field comparison operations on the system comparison fields in the data comparison rules, the second subcommand is determined. Optionally, when the second subcommand is used for execution, it realizes the processing of comparing different fields in the two difference result tables based on the data comparison rules; in some optional examples, for example, according to the verification benchmark (based on both parties AB, A unilaterally (comparison data in the first data system) or B unilaterally (comparison data in the second data system)), the second subcommand (which can be in SQL format) is generated based on the aggregation dimension, the difference comparison condition, the first query command (queryA) and the second query command (queryB): outer_diff_A_B; the first subcommand can identify the number of differences between the first difference result table and the second difference result table (that is, one of the two tables is missing a number).

[0125] Based on the first subcommand and the second subcommand, a second processing command is generated.

[0126] Optionally, the second processing command includes a first table processing command (corresponding to the first difference result table) and a second table processing command (corresponding to the second difference result table); when the first table processing command is executed, the post-execution data is written into the first difference result table; when the second table processing command is executed, the post-execution data is written into the second difference result table.

[0127] Optionally, statistics are collected on the command parts of the first subcommand and the second subcommand corresponding to the first data system to obtain the write command corresponding to the first difference result table; for example, the SQL for writing the difference of table A (the first table processing command) is generated according to inner_diff_A_B and outer_diff_A_B: insert_diff_A. The SQL for writing the difference of table B (the second table processing command) is generated according to inner_diff_A_B and outer_diff_A_B: insert_diff_B

[0128] Step 1064: determine a command database based on the first processing command and the second processing command.

[0129] In this embodiment, by processing various conditions in the data comparison rules into executable commands, all the executable commands (hiveSQL) obtained are summarized and saved, and a command database can be obtained. Optionally, the command database is a MySQL database, and the MySQL database can interact with the user. For example, in some optional examples, temp_insert_diff_A, insert_diff_A, temp_insert_diff_B and insert_diff_B are counted to generate an overall executable hiveSQL, and the hiveSQL is stored in the MySQL database.

[0130] In some optional examples, the processing commands stored in the command database may be determined based on the following pseudo code:

[0131]

[0132]

[0133]

[0134] like Figure 3 As shown in the above Figure 1 Based on the illustrated embodiment, step 108 may include the following steps:

[0135] Step 1081 , receiving first data to be compared in a first data system and second data to be compared in a second data system, and triggering a read instruction.

[0136] The first data and the second data may be data in any form such as text, field, image, text, video, etc.

[0137] In this embodiment, a first difference result table for storing difference data is established for the first data system, and a second difference result table for storing difference data is established for the second data system; when the first difference result table and the second difference result table are initially established, they are empty. After receiving the first data and the second data, the first data and the second data are stored in the first difference result table, and the first data and the second data are stored in the second difference result table. When there are data (difference data obtained by comparing the previous version) in the first difference result table and the second difference result table obtained by comparing different times, version numbers are assigned to the first difference result table and the second difference result table. For example, data is updated in units of days, and the first difference result table and the second difference result table updated on October 1 are respectively numbered A1 and B1. On October 2, data comparison is continued based on versions A1 and B1, and the first difference result table and the second difference result table updated on October 2 are respectively numbered A2 and B2, and so on.

[0138] Step 1082, read the query command table in the command database through the read instruction.

[0139] Optionally, the query command table includes all executable commands stored in the command database, and the query command table can be read by spark to obtain executable commands that can compare the first data and the second data; since spark has a large data processing capability, data processing efficiency is improved.

[0140] Step 1083: perform a comparison on the first data and the second data according to the multiple processing commands included in the query command table to determine a data comparison result.

[0141] The multiple processing commands in this embodiment include at least one first processing command and / or at least one second processing command obtained in the above embodiment. Multiple processing commands can be executed simultaneously. By executing multiple processing commands in parallel, the efficiency of data comparison is improved. In each processing command, data is processed serially, that is, each processing command processes one piece of data each time it is executed.

[0142] Optionally, the Java code is deployed in the Spark task of the big data platform, and the Java code reads the query command table (hivesql statement) stored in the command database (MySQL database); the overall process of the big data Spark serial calculation is used to read and execute the verification rule content and status in the MySQL database.

[0143] In some optional embodiments, the two parties performing data comparison store the comparison results separately, that is, the data comparison results include a first comparison result and a second comparison result; the first comparison result corresponds to the first data system, and the second comparison result corresponds to the second data system.

[0144] Step 1083 may include:

[0145] A comparison process is performed on the first data and the second data based on a plurality of processing commands, and a first difference result table corresponding to the first data system is updated with the comparison process result to obtain a first comparison result.

[0146] Optionally, the comparison and update process may include:

[0147] The comparison result data corresponding to at least one processing command that has been executed among multiple processing commands is stored in a first temporary difference table; by storing the comparison result data corresponding to at least one processing command that has been executed in the first temporary difference table, the problem of data comparison errors is avoided, and the comparison data of different versions are isolated, and the calculations do not affect each other, thereby improving the accuracy of data processing.

[0148] A comparison process is performed on the first data and the second data based on at least one processing command that has not been executed among multiple processing commands to obtain first difference data; after the comparison result data obtained by the previous comparison is stored in the first difference temporary table, the data in the first difference result table are all data corresponding to the processing commands that have not been executed. At this time, a comparison process is performed on the first data and the second data based on the executable processing command that has not been executed to obtain the first difference data of the current version.

[0149] The first difference result table is updated based on the first difference data and the data in the first difference temporary table to obtain a first comparison result. Optionally, the update of the first difference result table (hiveA table) is achieved through full coverage.

[0150] In addition, after the current processing command is executed, the status of the current processing command is changed to executed.

[0151] In this embodiment, by storing other data in the first difference temporary table before executing the current processing command, independent processing of different data processing rules is achieved. When there are multiple processing commands, multiple processing commands can be executed at the same time to achieve parallel processing of processing commands. When multiple processing commands are not executed simultaneously, each processing command can be taken as the current processing command in turn, and the first data and the second data are processed based on the current processing command to obtain difference data corresponding to each processing command respectively. The difference data corresponding to all processing commands constitute the first difference data. The first difference data and other data stored in the first difference temporary table are used together to update the first difference result table to achieve the table update of the current time version (pt overwrite), and obtain the first difference result table (hiveA table) of the current time version. At this time, what is stored in the first difference result table is the first comparison result. When the first difference result table is updated with the time version next time, the first comparison result is other data.

[0152] A comparison process is performed on the first data and the second data based on a plurality of processing commands, and a second difference result table corresponding to the second data system is updated with the comparison process result to obtain a second comparison result.

[0153] The comparison result data corresponding to at least one of the executed processing commands among the multiple processing commands is stored in the second temporary difference table. By storing the comparison result data corresponding to at least one of the executed processing commands in the second temporary difference table, the problem of data comparison errors is avoided, and the comparison data of different versions are isolated, and the calculations do not affect each other, thereby improving the accuracy of data processing.

[0154] Performing a comparison process on the first data and the second data based on at least one processing command that has not been executed among the multiple processing commands to obtain second difference data;

[0155] The second difference result table is updated based on the second difference data and the data in the second difference temporary table to obtain a second comparison result. Optionally, the update of the second difference result table (hiveB table) is achieved by full coverage.

[0156] In addition, after the current processing command is executed, the status of the current processing command is changed to executed.

[0157] In this embodiment, the processing of the second difference result table is similar to the processing process of the first difference result table, and can be understood by reference. The only difference is that the corresponding processing commands are multiple processing commands determined by the data comparison rules corresponding to the second data system.

[0158] The disclosed embodiment integrates big data computing and storage capabilities, Java logic control capabilities, and MySQL's real-time data storage. Through the close cooperation of the three, the verification of billions of data is completed. Optionally, the difference data of the disclosed embodiment is calculated once every preset time interval (for example, one day) (full coverage is performed once), and the verification content is the full amount of data, which can save a lot of data comparison time for the verification personnel, avoid the backlog of data problems, and achieve daily verification and settlement of data. And a complete judgment can be made on the overall data compliance of the business since its launch (when there is difference data when comparing the data, it means that the data is non-compliant).

[0159] In some optional embodiments, the embodiments of the present disclosure may further include:

[0160] Display the data comparison results.

[0161] In this embodiment, in order to allow the checkers to view and process the data comparison results (for example, query, delete, etc.), a display interface is provided to display the data comparison results, for example, the data comparison results are displayed on an interactive page.

[0162] Optionally, display the data comparison results, including:

[0163] The data comparison results are displayed according to the preset display rules.

[0164] Optionally, when displaying the data comparison results through the interactive terminal, when receiving the configuration information of the first data system, the second data system and the system comparison field to be compared, the display configuration information corresponding to the display rule can be received, and the displayed form, icon, etc. can be configured based on the display configuration information to obtain the corresponding display rule, for example, the display rule is configured to display based on the form combined with the bar chart. Optionally, the mysql database is used as the display terminal of the data comparison results, for example, a hive2mysql task is created, and the data comparison results (hiveA and hiveB) are written back to the MySQL database according to pt (time version) to meet the user's viewing and processing.

[0165] Any data comparison method provided in the embodiments of the present disclosure may be executed by any appropriate device with data processing capabilities, including but not limited to: a terminal device and a server, etc. Alternatively, any data comparison method provided in the embodiments of the present disclosure may be executed by a processor, such as the processor executing any data comparison method mentioned in the embodiments of the present disclosure by calling corresponding instructions stored in a memory. This will not be described in detail below.

[0166] Exemplary Devices

[0167] Figure 4 Schematic diagram of the structure of a data comparison device provided by an exemplary embodiment of the present disclosure. Figure 4 As shown, the data comparison device provided in this embodiment includes:

[0168] The information configuration module 41 is used to determine the first data system, the second data system and the system comparison field to be compared according to the received configuration information.

[0169] The rule determination module 42 is used to determine corresponding data comparison rules according to the first data system, the second data system and the system comparison field.

[0170] The rule storage module 43 is used to determine the command database based on the data comparison rule.

[0171] The command database is used to store executable query command tables.

[0172] The data comparison module 44 is used to read the query command table stored in the command database, perform comparison on the data received from the first data system and the second data system based on the query command table, and determine the data comparison result.

[0173] Based on the data comparison device provided by the above-mentioned embodiment of the present disclosure, according to the received configuration information, the first data system, the second data system and the system comparison field to be compared are determined; according to the first data system, the second data system and the system comparison field, the corresponding data comparison rules are determined; based on the data comparison rules, a command database is determined; wherein the command database includes an executable query command table; the query command table in the command database is read, and the data received from the first data system and the second data system are compared based on the query command table to determine the data comparison result; the embodiment of the present disclosure determines the corresponding data comparison rules through configuration, realizes flexible configuration of the data comparison rules, matches the data with the data comparison rules, and realizes data comparison of the first data system and the second data system based on the query command table, realizes large-scale automatic data comparison, and solves the problems of slow offline manual verification and failure to detect data deviations in time.

[0174] In some optional embodiments, the rule determination module 42 is specifically used to query the preset rule library based on the first data system, the second data system and the system comparison field to determine whether there is a corresponding preset comparison rule; wherein a plurality of preset comparison rules are pre-stored in the preset rule library; in response to the existence of a corresponding preset comparison rule, the corresponding preset comparison rule is used as the data comparison rule; in response to the absence of a corresponding preset comparison rule, rule configuration information is received through a configuration template to determine the data comparison rule.

[0175] In some optional embodiments, the rule storage module 43 includes:

[0176] A query command unit, used to generate a first query command and a second query command according to a data comparison rule; wherein the first query command corresponds to the first data system, and the second query command corresponds to the second data system;

[0177] A first processing command unit, used for generating a first processing command for processing the non-regular data according to the processing operation of the non-regular data included in the data comparison rule;

[0178] A second processing command unit, used for generating a second processing command for processing rule data according to the data difference processing operation included in the data comparison rule, the first query command and the second query command;

[0179] The command storage unit is used to determine a command database based on the first processing command and the second processing command.

[0180] Optionally, the second processing command unit is specifically used to determine the first sub-command based on the first query command, the second query command, and the same field comparison operation on the system comparison field in the data comparison rules; determine the second sub-command based on the first query command, the second query command, and the different field comparison operations on the system comparison field in the data comparison rules; and generate the second processing command based on the first sub-command and the second sub-command.

[0181] In some optional embodiments, the data comparison module 44 includes:

[0182] A data receiving unit, used for receiving first data to be compared in the first data system and second data to be compared in the second data system, and triggering a read instruction;

[0183] A command reading unit, used for reading a query command table in a command database through a reading instruction;

[0184] A comparison execution unit is used to perform a comparison on the first data and the second data according to a plurality of processing commands included in the query command table to determine a data comparison result; the plurality of processing commands include at least one of the first processing command and / or at least one of the second processing command.

[0185] Optionally, the data comparison result includes a first comparison result and a second comparison result; the first comparison result corresponds to the first data system, and the second comparison result corresponds to the second data system;

[0186] The comparison execution unit is specifically used to perform comparison processing on the first data and the second data based on multiple processing commands, and update the first difference result table corresponding to the first data system with the comparison processing result to obtain a first comparison result; perform comparison processing on the first data and the second data based on multiple processing commands, and update the second difference result table corresponding to the second data system with the comparison processing result to obtain a second comparison result.

[0187] Optionally, the comparison execution unit performs comparison processing on the first data and the second data based on multiple processing commands, updates the first difference result table corresponding to the first data system with the comparison processing result, and obtains the first comparison result. The comparison execution unit is used to store the comparison result data corresponding to at least one processing command that has been executed among the multiple processing commands into the first difference temporary table; performs comparison processing on the first data and the second data based on at least one processing command that has not been executed among the multiple processing commands to obtain first difference data; and updates the first difference result table based on the first difference data and the data in the first difference temporary table to obtain the first comparison result.

[0188] Optionally, the comparison execution unit performs comparison processing on the first data and the second data based on multiple processing commands, updates the second difference result table corresponding to the second data system with the comparison processing result, and obtains the second comparison result. The comparison execution unit is used to store the comparison result data corresponding to at least one processing command that has been executed among the multiple processing commands into the second difference temporary table; performs comparison processing on the first data and the second data based on at least one processing command that has not been executed among the multiple processing commands to obtain second difference data; and updates the second difference result table based on the second difference data and the data in the second difference temporary table to obtain the second comparison result.

[0189] In some optional embodiments, the device provided in this embodiment may further include:

[0190] Data display module, used to display data comparison results.

[0191] Optionally, the data display module is specifically used to display the data comparison results according to preset display rules.

[0192] Exemplary Electronic Devices

[0193] Below, reference Figure 5 The electronic device according to the embodiment of the present disclosure is described. The electronic device may be any one or both of the first device and the second device, or a stand-alone device independent of them, and the stand-alone device may communicate with the first device and the second device to receive the collected input signals from them.

[0194] Figure 5 A block diagram of an electronic device according to an embodiment of the present disclosure is illustrated.

[0195] like Figure 5 As shown, the electronic device includes one or more processors and memory.

[0196] The processor may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device to perform desired functions.

[0197] The memory may store one or more computer program products, and the memory may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, a random access memory (RAM) and / or a cache memory (cache), etc. The non-volatile memory may include, for example, a read-only memory (ROM), a hard disk, a flash memory, etc. One or more computer program products may be stored on the computer-readable storage medium, and the processor may run the computer program product to implement the data comparison method of each embodiment of the present disclosure described above and / or other desired functions.

[0198] In one example, the electronic device may further include: an input device and an output device, and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0199] In addition, the input device may also include, for example, a keyboard, a mouse, and the like.

[0200] The output device can output various information to the outside, including determined distance information, direction information, etc. The output device can include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, and the like.

[0201] Of course, to simplify, Figure 5 Only some of the components related to the present disclosure in the electronic device are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, according to specific application situations, the electronic device may further include any other appropriate components.

[0202] In addition to the above-mentioned methods and devices, an embodiment of the present disclosure may also be a computer program product, which includes computer program instructions, which, when executed by a processor, enable the processor to execute the steps of the data comparison method according to various embodiments of the present disclosure described in the above part of this specification.

[0203] The computer program product may be written in any combination of one or more programming languages ​​to write program code for performing the operations of the disclosed embodiments, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0204] In addition, an embodiment of the present disclosure may also be a computer-readable storage medium having computer program instructions stored thereon, which, when executed by a processor, enables the processor to execute the steps of the data comparison method according to various embodiments of the present disclosure described in the above part of this specification.

[0205] The computer readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0206] The basic principles of the present disclosure are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present disclosure are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required by each embodiment of the present disclosure. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, and are not limitations. The above details do not limit the present disclosure to the necessity of adopting the above specific details to be implemented.

[0207] Each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the system embodiment, since it basically corresponds to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0208] The block diagrams of the devices, apparatuses, equipment, and systems involved in this disclosure are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagrams. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including," "comprising," "having," and the like are open words, referring to "including but not limited to," and can be used interchangeably therewith. The words "or" and "and" used herein refer to the words "and / or," and can be used interchangeably therewith, unless the context clearly indicates otherwise. The word "such as" used herein refers to the phrase "such as but not limited to," and can be used interchangeably therewith.

[0209] The method and apparatus of the present disclosure may be implemented in many ways. For example, the method and apparatus of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above order of steps for the method is for illustration only, and the steps of the method of the present disclosure are not limited to the order specifically described above, unless otherwise specifically stated. In addition, in some embodiments, the present disclosure may also be implemented as a program recorded in a recording medium, which includes machine-readable instructions for implementing the method according to the present disclosure. Therefore, the present disclosure also covers a recording medium storing a program for executing the method according to the present disclosure.

[0210] It should also be noted that in the apparatus, device and method of the present disclosure, each component or each step can be decomposed and / or recombined. Such decomposition and / or recombination should be regarded as equivalent solutions of the present disclosure.

[0211] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

[0212] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present disclosure to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims

1. A data comparison method, characterized in that: include: Determine, according to the received configuration information, a first data system, a second data system, and a system comparison field to be compared; Determining corresponding data comparison rules according to the first data system, the second data system and the system comparison field; Based on the data comparison rule, determine a command database; wherein the command database is used to store an executable query command table; The query command table stored in the command database is read, and based on the query command table, data received from the first data system and the second data system are compared to determine a data comparison result.

2. The method according to claim 1, characterized in that The step of determining a command database based on the data comparison rule includes: Generate a first query command and a second query command according to the data comparison rule; wherein the first query command corresponds to the first data system, and the second query command corresponds to the second data system; Generate a first processing command for processing the non-regular data according to the processing operation of the non-regular data included in the data comparison rule; Generate a second processing command for processing rule data according to the data difference processing operation included in the data comparison rule, the first query command and the second query command; The command database is determined based on the first processing command and the second processing command.

3. The method according to claim 2, characterized in that The step of generating a second processing command for processing rule data according to the data difference processing operation included in the data comparison rule, the first query command, and the second query command comprises: Determine a first subcommand according to the first query command, the second query command, and the same field comparison operation on the system comparison field in the data comparison rule; Determine a second sub-command according to the first query command, the second query command, and different field comparison operations on the system comparison field in the data comparison rule; Based on the first subcommand and the second subcommand, the second processing command is generated.

4. The method according to claim 2 or 3, characterized in that: The reading the query command table in the command database, comparing the data received from the first data system and the second data system based on the query command table, and determining a data comparison result includes: receiving first data to be compared in the first data system and second data to be compared in the second data system, and triggering a read instruction; Read the query command table in the command database through the read instruction; The first data and the second data are compared according to a plurality of processing commands included in the query command table to determine the data comparison result; the plurality of processing commands include at least one of the first processing command and / or at least one of the second processing command.

5. The method according to claim 4, characterized in that The data comparison result includes a first comparison result and a second comparison result; the first comparison result corresponds to a first data system, and the second comparison result corresponds to a second data system; The comparing the first data and the second data according to the multiple processing commands included in the query command table to determine the data comparison result includes: Performing comparison processing on the first data and the second data based on the multiple processing commands, and updating a first difference result table corresponding to the first data system with the comparison processing result to obtain a first comparison result; Based on the multiple processing commands, a comparison process is performed on the first data and the second data, and a second difference result table corresponding to the second data system is updated with the comparison process result to obtain a second comparison result.

6. The method according to claim 5, characterized in that The performing comparison processing on the first data and the second data based on the multiple processing commands, and updating the first difference result table corresponding to the first data system with the comparison processing result to obtain the first comparison result, includes: storing the comparison result data corresponding to at least one of the executed processing commands in the multiple processing commands into a first temporary difference table; performing a comparison process on the first data and the second data based on at least one processing command that has not been executed among the multiple processing commands to obtain first difference data; The first difference result table is updated based on the first difference data and the data in the first difference temporary table to obtain the first comparison result.

7. The method according to claim 5 or 6, characterized in that: The performing comparison processing on the first data and the second data based on the multiple processing commands, and updating the second difference result table corresponding to the second data system with the comparison processing result to obtain the second comparison result, includes: storing the comparison result data corresponding to at least one of the executed processing commands in the plurality of processing commands into a second temporary difference table; performing a comparison process on the first data and the second data based on at least one processing command that has not been executed among the multiple processing commands to obtain second difference data; The second difference result table is updated based on the second difference data and the data in the second difference temporary table to obtain the second comparison result.

8. The method according to any one of claims 1 to 7, characterized in that: The determining corresponding data comparison rules according to the first data system, the second data system and the system comparison field includes: Based on the first data system, the second data system and the system comparison field, a preset rule library is queried to determine whether there is a corresponding preset comparison rule; wherein the preset rule library has a plurality of preset comparison rules pre-stored therein; In response to the existence of a corresponding preset comparison rule, using the corresponding preset comparison rule as the data comparison rule; In response to the absence of a corresponding preset comparison rule, rule configuration information is received through a configuration template to determine the data comparison rule.

9. The method according to any one of claims 1 to 8, characterized in that: Also includes: The data comparison results are displayed.

10. The method according to claim 9, characterized in that The display of the data comparison result includes: The data comparison results are displayed according to preset display rules.

11. An electronic device, characterized in that: include: a memory for storing a computer program product; A processor is used to execute the computer program product stored in the memory, and when the computer program product is executed, the data comparison method described in any one of claims 1 to 10 is implemented.

12. A computer program product comprising computer program instructions, characterized in that When the computer program instructions are executed by a processor, the data comparison method described in any one of claims 1 to 10 is implemented.