Offline automatic account checking method and device, computer equipment, medium and program product

Abstract

The invention relates to the technical field of data processing, and discloses an off-line automatic reconciliation method and device, computer equipment, a medium and a program product.The off-line automatic reconciliation method comprises the steps that in response to triggering of a reconciliation task instruction, a first reconciliation data table and a second reconciliation data table are obtained, the first reconciliation data table and the second reconciliation data table are both data tables stored in a target relational database; synchronizing data in the first reconciliation data table and the second reconciliation data table to a target data warehouse; and executing the structured query statement in the target data warehouse to compare the first reconciliation data table with the second reconciliation data table to obtain difference data, and storing the difference data in a difference temporary table of the target data warehouse. According to the invention, the data table is synchronized into the data warehouse to process a large batch of data, so that the account checking efficiency is improved, and the influence on an online system is reduced.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to an offline automatic reconciliation method, device, computer equipment, medium and program product. Background Art

[0002] Automatic reconciliation refers to the use of computer equipment to automatically check the bills or data of both parties and discover data differences (i.e. data inconsistencies). Offline reconciliation is a data verification method performed at a fixed period. It is mainly suitable for scenarios with low real-time requirements, such as checking the data of the previous day (day) on the next day (day), and checking the data of the previous month at the beginning of each month.

[0003] The offline automatic reconciliation method in the related art is: the bills or data of both parties are stored in a relational database management system (MySQL table), and the reconciliation task is automatically triggered by a scheduled task. When the reconciliation task is executed, a batch of bills or data are extracted from the bills or data of one party, and the corresponding bills or data of the other party are extracted according to the document number, and the two batches of bills or data are compared. The difference bills or data are stored in the reconciliation difference table, and the bills or data are extracted and compared multiple times until all the bills or data are compared.

[0004] However, this offline automatic reconciliation method has a large read and write volume, which will bring great pressure to the online relational database management system and even affect online business. In addition, this offline automatic reconciliation method is single-threaded and executed sequentially. When the amount of reconciliation data is large, it takes a long time and the reconciliation efficiency is low. Summary of the invention

[0005] In view of this, the present invention provides an offline automatic reconciliation method, apparatus, computer equipment, medium and program product to solve the problem of long time consumption and low reconciliation efficiency when the amount of reconciliation data is large.

[0006] In a first aspect, the present invention provides an offline automatic reconciliation method, comprising: in response to the triggering of a reconciliation task instruction, obtaining a first reconciliation data table and a second reconciliation data table, both of which are data tables stored in a target relational database; synchronizing data in the first reconciliation data table and the second reconciliation data table to a target data warehouse; executing a structured query statement in the target data warehouse to compare the first reconciliation data table and the second reconciliation data table to obtain difference data, and storing the difference data in a difference temporary table of the target data warehouse.

[0007] The present invention responds to the triggering of the reconciliation task instruction in an offline state, obtains the first reconciliation data table and the second reconciliation data table stored in the target relational database, and synchronizes the data in the first reconciliation data table and the second reconciliation data table to the target data warehouse. The reconciliation task of the present invention is executed in the target data warehouse. In the process of processing a large amount of data, it will not bring pressure to the online database and will not affect the operation of the online business. The present invention executes a structured query statement in the target data warehouse to compare the first reconciliation data table and the second reconciliation data table to obtain difference data, and stores the difference data in a difference temporary table of the target data warehouse. Compared with the related art, the present invention executes a structured query statement in the data warehouse to improve the execution efficiency of the reconciliation task. When the first reconciliation data table and the second reconciliation data table are stored in different target relational databases or different clusters, or the reconciliation task needs to rely on other relational databases, the data tables are directly synchronized to the target data warehouse to realize cross-cluster association operations, improve reconciliation efficiency, and improve stability during the execution of the reconciliation task.

[0008] In an optional implementation, obtaining a first reconciliation data table and a second reconciliation data table; synchronizing the data in the first reconciliation data table and the second reconciliation data table to a target data warehouse includes: subscribing to a binary log of a target relational database to obtain and synchronize the first reconciliation data table and the second reconciliation data table to the target data warehouse.

[0009] In an optional embodiment, executing a structured query statement in the target data warehouse to compare the first reconciliation data table and the second reconciliation data table includes: executing one or more structured query statements in the target data warehouse to compare multiple data in the first reconciliation data table and the second reconciliation data table.

[0010] In an optional embodiment, a structured query statement is executed in the target data warehouse to compare the first reconciliation data table and the second reconciliation data table, including: executing a structured query statement in the target data warehouse to match a first field in the first reconciliation data table with a second field in the second reconciliation data table corresponding to the first field; and comparing first data corresponding to the first field and second data corresponding to the second field.

[0011] The present invention first matches the first field in the first reconciliation data table with the second field corresponding to the first field in the second reconciliation data table, and then compares the first data corresponding to the first field with the second data corresponding to the second field, thereby achieving a comprehensive comparison of the reconciliation data tables and improving the accuracy of reconciliation task execution.

[0012] In an optional implementation, the difference data includes: missing data in the first reconciliation data table, missing data in the second reconciliation data table, data corresponding to inconsistent fields in the first reconciliation data table and the second reconciliation data table, duplicate data in the first reconciliation data table, and duplicate data in the second reconciliation data table.

[0013] In an optional implementation, after storing the difference data in a temporary difference table of the target data warehouse, the offline automatic reconciliation method further includes: synchronizing the difference data in the temporary difference table to the target relational database to display the difference data.

[0014] The present invention synchronizes the difference data in the difference temporary table to the target relational database to display the difference data, which is convenient for directly reading the difference data from the target relational database. The difference data can be displayed in a visualization page or exported into a table, which is convenient for users to troubleshoot reconciliation problems based on the difference data.

[0015] In a second aspect, the present invention provides an offline automatic reconciliation device, comprising: a reconciliation data table acquisition module, used to respond to the triggering of a reconciliation task instruction, to acquire a first reconciliation data table and a second reconciliation data table, both of which are data tables stored in a target relational database; a reconciliation data table synchronization module, used to synchronize the data in the first reconciliation data table and the second reconciliation data table to a target data warehouse; a reconciliation data table comparison module, used to execute a structured query statement in the target data warehouse to compare the first reconciliation data table and the second reconciliation data table to obtain difference data, and store the difference data in a difference temporary table of the target data warehouse.

[0016] In a third aspect, the present invention provides a computer device, comprising: a memory and a processor, the memory and the processor being communicatively connected to each other, the memory storing computer instructions, and the processor executing the offline automatic reconciliation method of the first aspect or any corresponding embodiment thereof by executing the computer instructions.

[0017] In a fourth aspect, the present invention provides a computer-readable storage medium having computer instructions stored thereon, the computer instructions being used to enable a computer to execute the offline automatic reconciliation method of the first aspect or any corresponding embodiment thereof.

[0018] In a fifth aspect, the present invention provides a computer program product, comprising computer instructions, wherein the computer instructions are used to enable a computer to execute the offline automatic reconciliation method of the above-mentioned first aspect or any corresponding embodiment thereof. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the related technologies, the drawings required for use in the specific embodiments or the related technical descriptions will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0020] Figure 1 is a flow chart of an offline automatic reconciliation method according to an embodiment of the present invention;

[0021] Figure 2 is a flow chart of another offline automatic reconciliation method according to an embodiment of the present invention;

[0022] Figure 3 is a schematic diagram of examples of a first reconciliation data table and a second reconciliation data table according to an embodiment of the present invention;

[0023] Figure 4 is a schematic diagram of an example of difference data according to an embodiment of the present invention;

[0024] Figure 5 is a flowchart of another offline automatic reconciliation method according to an embodiment of the present invention;

[0025] Figure 6 is a structural block diagram of an offline automatic reconciliation device according to an embodiment of the present invention;

[0026] Figure 7 It is a schematic diagram of the hardware structure of a computer device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0027] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0028] In the related art, the common implementation method of offline automatic reconciliation is: store the data in a MySQL table, automatically trigger the execution of the reconciliation task through a scheduled task, and reconcile with the second reconciliation data table based on the first reconciliation data table. The reconciliation task first pulls a batch of data from the first reconciliation data table, and pulls the corresponding data in the second reconciliation data table according to the document number. The two batches of data in the first reconciliation data table and the second reconciliation data table are compared through the business code to determine whether there are missing records in the second reconciliation data table, or the amount is inconsistent with the first reconciliation data table, and the difference records are saved in the reconciliation difference table until all records in the first reconciliation data table are compared.

[0029] However, this method has limitations: First, when reading bill data, the online business database is used directly. Due to the large amount of read and write, it will bring great pressure to the online database and even affect the online business, which has a high technical risk; second, because it is a single-threaded sequential execution, when the amount of reconciliation data is large, it takes a long time, especially when there are multiple reconciliation scenarios, the overall time will be very long and cannot meet the reconciliation needs; third, it cannot support cross-cluster association operations or subqueries. When the first reconciliation data table and the second reconciliation data table are located in different databases or even different clusters, when it is necessary to rely on data tables in other databases for association operations to filter the reconciliation data, it cannot support cross-database or cross-cluster association operations.

[0030] The embodiment of the present invention provides an offline automatic reconciliation method, which synchronizes a reconciliation data table to a data warehouse for reconciliation, thereby achieving the effect of improving reconciliation efficiency.

[0031] According to an embodiment of the present invention, an embodiment of an offline automatic reconciliation method is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0032] In this embodiment, an offline automatic reconciliation method is provided, which can be used in a computer device. Figure 1 is a flow chart of an offline automatic reconciliation method according to an embodiment of the present invention. Figure 1 As shown, the process includes the following steps:

[0033] Step S101, in response to triggering of a reconciliation task instruction, obtaining a first reconciliation data table and a second reconciliation data table, wherein the first reconciliation data table and the second reconciliation data table are both data tables stored in a target relational database.

[0034] Among them, the triggering method of the reconciliation task instruction can be automatic triggering or manual triggering; the automatic triggering method is to set the reconciliation task as a scheduled task, and automatically trigger the reconciliation task at the time corresponding to the scheduled task. For example, the reconciliation task is automatically executed at 10 am every day. The automatic triggering method can also be that when data update is detected, the first reconciliation data table and the second reconciliation data table are automatically obtained in real time; the manual triggering method is to issue a reconciliation task instruction in response to the user triggering the preset control. For example, the user clicks the "Reconciliation" control to execute the reconciliation task instruction; the reconciliation task can be one or more.

[0035] In some optional implementations, the first reconciliation data table and the second reconciliation data table are data tables adapted to the target relational database storage format for storing the data to be reconciled, and both the first reconciliation data table and the second reconciliation data table are in table format.

[0036] In some optional implementations, the target relational database is a MySQL (Structured Query Language) database.

[0037] In some optional implementations, obtaining the first reconciliation data table and the second reconciliation data table includes: subscribing to a binary log of a target relational database to obtain the first reconciliation data table and the second reconciliation data table.

[0038] Among them, the binary log (Binary Log, BinLog) is a log file that records all modification operations in the target relational database, where modification operations include insertion, update, copy, deletion, etc. The key functions of BinLog include: data recovery, data replication, audit and analysis. Data recovery is to use BinLog to restore data to a specific time point; data replication is to synchronize data changes in the master database to the slave database to achieve data consistency; audit and analysis is to record the operations of the target relational database for analysis and auditing; BinLog files include multiple files and record change events in chronological order.

[0039] Step S102: synchronizing the data in the first reconciliation data table and the second reconciliation data table to the target data warehouse.

[0040] The target data warehouse may be Hive, Open Data Processing Service (ODPS) or other data warehouses.

[0041] In some optional implementations, synchronizing the data in the first reconciliation data table and the second reconciliation data table to the target data warehouse includes: subscribing to the binary log of the target relational database to synchronize the first reconciliation data table and the second reconciliation data table to the target data warehouse.

[0042] In an embodiment of the present invention, synchronizing the data in the first reconciliation data table and the second reconciliation data table to the target data warehouse includes: converting the data in the first reconciliation data table and the second reconciliation data table into a format suitable for the target data warehouse, and storing the data in the first reconciliation data table and the second reconciliation data table after the conversion in the target data warehouse; synchronizing the data in the first reconciliation data table and the second reconciliation data table to the target data warehouse also includes: copying the data in the first reconciliation data table and the second reconciliation data table to the target data warehouse.

[0043] Step S103, executing a structured query statement in the target data warehouse to compare the first reconciliation data table with the second reconciliation data table to obtain difference data, and storing the difference data in a difference temporary table of the target data warehouse.

[0044] In some optional embodiments, executing a structured query statement in the target data warehouse to compare the first reconciliation data table and the second reconciliation data table includes: executing one or more structured query statements in the target data warehouse to compare multiple data in the first reconciliation data table and the second reconciliation data table.

[0045] The structured query language (SQL) is a standard statement written based on the first reconciliation data table and the second reconciliation data table and is used to compare the first reconciliation data table and the second reconciliation data table.

[0046] In some optional implementations, writing a structured query statement based on the first reconciliation data table and the second reconciliation data table includes: writing a structured query statement for each of the multiple difference types, and combining the execution results of each structured query statement using a union operator (UNIONALL); writing a structured query statement based on the first reconciliation data table and the second reconciliation data table, and also includes: performing a full join (FULL JOIN) on the first reconciliation data table and the second reconciliation data table, and writing a structured query statement for comparing the first reconciliation data table and the second reconciliation data table to find all differences at one time; writing a structured query statement based on the first reconciliation data table and the second reconciliation data table, and also includes: writing a structured query statement for each of the multiple difference types, performing a full join (FULL JOIN) on the first reconciliation data table and the second reconciliation data table, and writing a structured query statement for comparing the first reconciliation data table and the second reconciliation data table, and obtaining difference data using multiple structured query statements.

[0047] In some optional implementations, the difference data includes: missing data in the first reconciliation data table, missing data in the second reconciliation data table, data corresponding to inconsistent fields in the first reconciliation data table and the second reconciliation data table, duplicate data in the first reconciliation data table, and duplicate data in the second reconciliation data table.

[0048] Among them, the missing data in the first reconciliation data table are data that only exist in the second reconciliation data table but not in the first reconciliation data table; the missing data in the second reconciliation data table are data that only exist in the first reconciliation data table but not in the second reconciliation data table; the data corresponding to the inconsistent fields in the first reconciliation data table and the second reconciliation data table are inconsistencies in core fields, such as inconsistent order amounts, inconsistent commodity quantities, etc.; the duplicate data in the first reconciliation data table are data repeated in the first reconciliation data table; the duplicate data in the second reconciliation data table are data repeated in the second reconciliation data table.

[0049] The offline automatic reconciliation method provided by the present embodiment includes: in an offline state, in response to the triggering of the reconciliation task instruction, obtaining the first reconciliation data table and the second reconciliation data table stored in the target relational database, synchronizing the data in the first reconciliation data table and the second reconciliation data table to the target data warehouse. The reconciliation task of the embodiment of the present invention is executed in the target data warehouse. In the process of processing a large amount of data, it will not bring pressure to the online database and will not affect the operation of the online business. The embodiment of the present invention executes a structured query statement in the target data warehouse to compare the first reconciliation data table and the second reconciliation data table to obtain difference data, and stores the difference data in the difference temporary table of the target data warehouse. The embodiment of the present invention is different from the related art. Compared with the traditional method of executing structured query statements in the data warehouse, the execution efficiency of the reconciliation task is improved. When the first reconciliation data table and the second reconciliation data table are stored in different target relational databases or different clusters, or the reconciliation task needs to rely on other relational databases, the data tables are directly synchronized to the target data warehouse to realize cross-cluster association operations, improve reconciliation efficiency, and improve the stability of the reconciliation task execution process. The offline automatic reconciliation method of the embodiment of the present invention is applied to systems with high requirements for data consistency, such as financial systems. It is not affected by human factors, ensures the accuracy of financial data in each link, and can quickly identify difference data, issue alarms in time, effectively prevent financial risks, and improve the security of systems with high requirements for data consistency.

[0050] In this embodiment, an offline automatic reconciliation method is provided, which can be used in a computer device. Figure 2 is a flow chart of another offline automatic reconciliation method according to an embodiment of the present invention. Figure 2 As shown, the process includes the following steps:

[0051] Step S201, in response to the triggering of the reconciliation task instruction, obtain a first reconciliation data table and a second reconciliation data table, both of which are data tables stored in the target relational database. Figure 1 Step S101 of the illustrated embodiment will not be described in detail here.

[0052] Step S202: Synchronize the data in the first reconciliation data table and the second reconciliation data table to the target data warehouse. Figure 1 Step S102 of the illustrated embodiment will not be described in detail here.

[0053] Step S203, executing a structured query statement in the target data warehouse to compare the first reconciliation data table with the second reconciliation data table to obtain difference data, and storing the difference data in a difference temporary table of the target data warehouse.

[0054] Specifically, the above step S203 includes:

[0055] Step S2031: execute a structured query statement in the target data warehouse to match a first field in the first reconciliation data table with a second field in the second reconciliation data table that corresponds to the first field.

[0056] Step S2032, comparing the first data corresponding to the first field and the second data corresponding to the second field.

[0057] For example, Figure 3 As shown, it is a schematic diagram of an example of a first reconciliation data table and a second reconciliation data table. In the first reconciliation data table, the identifier, the value and the order number are the first field, and the value corresponding to the identifier, the value and the order number is the first data; in the second reconciliation data table, the identifier, the value and the order number are the second field, and the value corresponding to the identifier, the value and the order number is the second data; first match the first field and the second field, and then compare the first data corresponding to the first field and the second data corresponding to the second field. There may be multiple first fields and second fields, and then there are multiple first data corresponding to the first field and the second data corresponding to the second field. Based on the pre-setting, only at least one core field among the multiple first fields and the multiple second fields can be matched, and only the first data and the second data corresponding to the at least one core field can be compared respectively.

[0058] like Figure 4 As shown, it is a schematic diagram of an example of difference data; the value corresponding to the identifier 2 in the first reconciliation data table is 40, and the value corresponding to the identifier 102 in the second reconciliation data table is 45, so the difference data is inconsistent values; the value 50 and order number C corresponding to the identifier 3 in the first reconciliation data table do not exist in the second reconciliation data table, so the difference data is missing in the second reconciliation data table; the value 55 and order number D corresponding to the identifier 4 in the second reconciliation data table do not exist in the first reconciliation data table, so the difference data is missing in the first reconciliation data table.

[0059] Step S204: Synchronize the difference data in the temporary difference table to the target relational database to display the difference data.

[0060] The temporary difference table records the difference data of all reconciliation tasks, and generally includes the following fields: primary key, name of the first reconciliation data table, name of the second reconciliation data table, difference type, difference amount, and core business fields (such as order identifier, amount of the first reconciliation data table, amount of the second reconciliation data table, etc.) and extended fields (used to store personalized content for each reconciliation task).

[0061] In some optional implementations, the difference data is displayed in a visualization page or exported into a table (Excel).

[0062] The embodiment of the present invention first matches the first field in the first reconciliation data table with the second field corresponding to the first field in the second reconciliation data table, and then compares the first data corresponding to the first field and the second data corresponding to the second field, so as to achieve a comprehensive comparison of the reconciliation data table and improve the accuracy of the reconciliation task execution. The embodiment of the present invention synchronizes the difference data in the difference temporary table to the target relational database to display the difference data, so as to facilitate the direct reading of the difference data from the target relational database, and the difference data can be displayed in a visualization page or exported into a table, so as to facilitate the user to troubleshoot the reconciliation problem based on the difference data.

[0063] In this embodiment, an offline automatic reconciliation method is provided, which can be used in a computer device. Figure 5 is a flowchart of another offline automatic reconciliation method according to an embodiment of the present invention. Figure 5 As shown, the process includes the following steps:

[0064] By subscribing to the binary log of MySQL, the data of the first reconciliation data table located in the first MySQL cluster and the data of the second reconciliation data table located in the second MySQL cluster are synchronized to the data warehouse.

[0065] The reconciliation SOL is executed based on the first reconciliation data table and the second reconciliation data table, the first reconciliation data table and the second reconciliation data table are compared to generate difference data, and the difference data is inserted into the temporary table to obtain a difference table.

[0066] Synchronize the difference table to the third MySQL cluster and display the difference data.

[0067] This embodiment provides another offline automatic reconciliation method, in which the main steps of the reconciliation are performed in the data warehouse, which will not affect the online business. When processing large-scale data reconciliation, it has obvious advantages in terms of task time consumption. If the reconciliation depends on other MySQL databases, the required data tables can be directly synchronized to the data warehouse, thereby performing multi-table association operations or subqueries.

[0068] In this embodiment, an offline automatic reconciliation device is also provided, which is used to implement the above embodiments and preferred implementations, and will not be repeated here. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the device described in the following embodiments is preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0069] This embodiment provides an offline automatic reconciliation device, such as Figure 6 As shown, including:

[0070] The reconciliation data table acquisition module 601 is used to acquire a first reconciliation data table and a second reconciliation data table in response to the triggering of the reconciliation task instruction. The first reconciliation data table and the second reconciliation data table are both data tables stored in the target relational database.

[0071] The reconciliation data table synchronization module 602 is used to synchronize the data in the first reconciliation data table and the second reconciliation data table to the target data warehouse.

[0072] The reconciliation data table comparison module 603 is used to execute a structured query statement in the target data warehouse to compare the first reconciliation data table with the second reconciliation data table to obtain difference data, and store the difference data in a difference temporary table of the target data warehouse.

[0073] In some optional implementations, the reconciliation data table acquisition module 601 and the reconciliation data table synchronization module 602 include:

[0074] The log subscription unit is used to subscribe to the binary log of the target relational database to obtain and synchronize the first reconciliation data table and the second reconciliation data table to the target data warehouse.

[0075] In some optional implementations, the reconciliation data table comparison module 603 includes:

[0076] The multi-data comparison unit is used to execute one or more structured query statements in the target data warehouse to compare multiple data in the first reconciliation data table and the second reconciliation data table.

[0077] The field comparison unit is used to execute a structured query statement in the target data warehouse to match a first field in the first reconciliation data table with a second field in the second reconciliation data table corresponding to the first field.

[0078] The data comparison unit is used to compare the first data corresponding to the first field with the second data corresponding to the second field.

[0079] In some optional implementations, the offline automatic reconciliation device includes:

[0080] The difference data display module is used to synchronize the difference data in the difference temporary table to the target relational database to display the difference data.

[0081] The further functional description of each of the above modules and units is the same as that of the above corresponding embodiments and will not be repeated here.

[0082] The offline automatic reconciliation device in this embodiment is presented in the form of a functional unit, where the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and memory that executes one or more software or fixed programs, and / or other devices that can provide the above functions.

[0083] The embodiment of the present invention also provides a computer device having the above Figure 6 The offline automatic reconciliation device shown.

[0084] See also Figure 7 , Figure 7 is a schematic diagram of the structure of a computer device provided by an optional embodiment of the present invention, such as Figure 7 As shown, the computer device includes: one or more processors 10, a memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. Various components are connected to each other using different buses for communication, and can be installed on a common mainboard or installed in other ways as needed. The processor can process the instructions executed in the computer device, including instructions stored in or on the memory to display the graphical information of the GUI on an external input / output device (such as, a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple computer devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 7 A processor 10 is taken as an example.

[0085] The processor 10 may be a central processing unit, a network processor or a combination thereof. The processor 10 may further include a hardware chip. The hardware chip may be a dedicated integrated circuit, a programmable logic device or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic or any combination thereof.

[0086] The memory 20 stores instructions executable by at least one processor 10, so that the at least one processor 10 executes the method shown in the above embodiment.

[0087] The memory 20 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 20 may optionally include a memory remotely arranged relative to the processor 10, and these remote memories may be connected to the computer device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0088] The memory 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid state drive; the memory 20 may also include a combination of the above types of memory.

[0089] The computer device further comprises a communication interface 30 for the computer device to communicate with other devices or a communication network.

[0090] The embodiment of the present invention also provides a computer-readable storage medium. The method according to the embodiment of the present invention can be implemented in hardware, firmware, or can be implemented as a computer code that can be recorded in a storage medium, or can be implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and will be stored in a local storage medium through a network download, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state hard disk, etc.; further, the storage medium can also include a combination of the above types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor, or hardware, the method shown in the above embodiment is implemented.

[0091] A part of the present invention may be applied as a computer program product, such as a computer program instruction, which, when executed by a computer, can call or provide the method and / or technical solution according to the present invention through the operation of the computer. Those skilled in the art should understand that the existence of the computer program instruction in a computer-readable medium includes, but is not limited to, a source file, an executable file, an installation package file, etc., and accordingly, the way in which the computer program instruction is executed by the computer includes, but is not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Here, the computer-readable medium may be any available computer-readable storage medium or communication medium accessible to the computer.

[0092] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. An offline automatic reconciliation method, characterized in that: The method comprises: In response to triggering of the reconciliation task instruction, a first reconciliation data table and a second reconciliation data table are acquired, wherein the first reconciliation data table and the second reconciliation data table are both data tables stored in a target relational database; Synchronize the data in the first reconciliation data table and the second reconciliation data table to the target data warehouse; A structured query statement is executed in the target data warehouse to compare the first reconciliation data table with the second reconciliation data table to obtain difference data, and the difference data is stored in a difference temporary table of the target data warehouse.

2. The method according to claim 1, characterized in that The obtaining of the first reconciliation data table and the second reconciliation data table; synchronizing the data in the first reconciliation data table and the second reconciliation data table to the target data warehouse includes: Subscribe to the binary log of the target relational database to obtain and synchronize the first reconciliation data table and the second reconciliation data table to the target data warehouse.

3. The method according to claim 1 or 2, characterized in that: The executing a structured query statement in the target data warehouse to compare the first reconciliation data table with the second reconciliation data table includes: One or more structured query statements are executed in the target data warehouse to compare a plurality of data in the first reconciliation data table and the second reconciliation data table.

4. The method according to claim 1 or 2, characterized in that: The executing a structured query statement in the target data warehouse to compare the first reconciliation data table with the second reconciliation data table includes: executing a structured query statement in the target data warehouse to match a first field in the first reconciliation data table with a second field in the second reconciliation data table that corresponds to the first field; The first data corresponding to the first field and the second data corresponding to the second field are compared.

5. The method according to claim 1 or 2, characterized in that: The difference data includes: missing data in the first reconciliation data table, missing data in the second reconciliation data table, data corresponding to inconsistent fields in the first reconciliation data table and the second reconciliation data table, repeated data in the first reconciliation data table, and repeated data in the second reconciliation data table.

6. The method according to claim 1 or 2, characterized in that: After storing the difference data in the difference temporary table of the target data warehouse, the method further includes: The difference data in the difference temporary table is synchronized to the target relational database to display the difference data.

7. An offline automatic reconciliation device, characterized in that: The device comprises: A reconciliation data table acquisition module, configured to acquire a first reconciliation data table and a second reconciliation data table in response to a trigger of a reconciliation task instruction, wherein the first reconciliation data table and the second reconciliation data table are both data tables stored in a target relational database; A reconciliation data table synchronization module, used to synchronize the data in the first reconciliation data table and the second reconciliation data table to a target data warehouse; A reconciliation data table comparison module is used to execute a structured query statement in the target data warehouse to compare the first reconciliation data table and the second reconciliation data table to obtain difference data, and store the difference data in a difference temporary table of the target data warehouse.

8. A computer device, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the offline automatic reconciliation method according to any one of claims 1 to 6 by executing the computer instructions.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the offline automatic reconciliation method according to any one of claims 1 to 6.

10. A computer program product, characterized in that The method comprises computer instructions for causing a computer to execute the offline automatic reconciliation method according to any one of claims 1 to 6.

Images