Heterogeneous data consistency detection method and device
A technology of data detection and detection method, applied in the field of data processing, can solve the problems of low efficiency in verifying the consistency of heterogeneous data, affecting other services of the data source system, and greatly affecting the performance of the data source system, so as to save system overhead and compare Efficiency optimization, performance impact optimization effect
Pending Publication Date: 2022-07-05
BANK OF CHINA
View PDF0 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] 1) It has a great impact on the performance of the data source system; the comparison action depends on the query of the data source. In a relational database, SQL query (SELECT) will have performance overhead, and this overhead will be proportional to the size of the query data set This overhead is reflected in the memory, disk I / O, and CPU occupation of the source system, which in turn will affect other businesses of the data source system
[0006] 2) The efficiency of verifying the consistency of heterogeneous data is low; when the scale of the data sets to be compared is large, the server for verifying the consistency of heterogeneous data will carry double the data sets and compare them in memory. The efficiency is also proportional to the size of the data set to be compared; in the case of large-scale data, the efficiency is not ideal
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0042] In order to make the purposes, technical solutions and advantages of the embodiments of the present invention more clearly understood, the embodiments of the present invention will be further described in detail below with reference to the accompanying drawings. Here, the exemplary embodiments of the present invention and their descriptions are used to explain the present invention, but not to limit the present invention.
[0043] In order to facilitate the understanding of this solution, the technical contents related to this solution are described below.
[0044] Relational database: Simply put, a relational database is a two-dimensional table and a data organization composed of connections between them. Three advantages of relational databases: Easy to understand: The two-dimensional table structure is a concept that is very close to the logical world, and the relational model is easier to understand than other models such as mesh and hierarchy. Ease of use: The gen...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a heterogeneous data consistency detection method and device, and relates to the technical field of finance, and the method comprises the steps: receiving a heterogeneous data detection request; according to the heterogeneous data detection request, obtaining first to-be-detected data from a first database server, and obtaining second to-be-detected data from a second database server; and respectively performing hash processing on the first to-be-detected data and the second to-be-detected data, and determining a consistency detection result of the first to-be-detected data and the second to-be-detected data according to respective hash processing results of the first to-be-detected data and the second to-be-detected data. According to the invention, the accuracy and efficiency of consistency detection of different-source data can be improved.
Description
technical field [0001] The invention relates to the technical field of data processing, and in particular, to a method and device for detecting consistency of heterologous data. Background technique [0002] This section is intended to provide a background or context to the embodiments of the invention recited in the claims. The descriptions herein are not admitted to be prior art by inclusion in this section. [0003] Relational database management system (RDBMS for short), as an important category of database systems, has a wide range of application scenarios; The logical form of the data collection is stored in the storage module. In actual production in all walks of life, there are often application scenarios in which data sets from two different sources are compared. For example, the data set is migrated from system A to system B. After the migration is completed, it is necessary to verify that the data set is completely consistent. For another example, in the syste...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/245G06F16/28
CPCG06F16/2255G06F16/284G06F16/245
Inventor 齐昕
Owner BANK OF CHINA