Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Database data consistency detection method and device, medium and electronic equipment

A detection method and data detection technology, applied in the database field, can solve problems such as data and source differences, affecting users' normal business, synchronization, etc.

Pending Publication Date: 2021-01-01
北京人大金仓信息技术股份有限公司 +1
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the current data consistency detection method has the following problems: when the user's business is frequent, the database throughput is very large, and a lock table operation will cause many businesses related to the table in the business to fail to proceed normally, affecting the normal operation of the user. business
When the amount of data in the user's business table is large, the time for consistency detection will increase significantly, which will cause the database lock to not be released for a long time, and also affect the normal business operation of the user
During data consistency detection, the operation of the data synchronization system must be stopped, so many other tables that have nothing to do with this data consistency detection cannot be synchronized normally, resulting in a large difference between the data on the target end and the source end
In addition, when data consistency detection is performed on multiple tables, multiple tables are locked at the same time, which has a certain impact on the operation of the database and increases the risk of deadlock

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Database data consistency detection method and device, medium and electronic equipment
  • Database data consistency detection method and device, medium and electronic equipment
  • Database data consistency detection method and device, medium and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] In order to more clearly understand the above objects, features and advantages of the present disclosure, the solutions of the present disclosure will be further described below. It should be noted that, in the case of no conflict, the embodiments of the present disclosure and the features in the embodiments can be combined with each other.

[0059] In the following description, many specific details are set forth in order to fully understand the present disclosure, but the present disclosure can also be implemented in other ways than described here; obviously, the embodiments in the description are only some of the embodiments of the present disclosure, and Not all examples.

[0060] figure 1 It is a flowchart of a database data consistency detection method shown in an embodiment of the present disclosure, and the database data consistency detection method may include the following steps:

[0061] Step S101: Obtain the first database connection of the source database...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a database data consistency detection method and device, a medium and electronic equipment, and the method comprises the steps: obtaining a first database connection of a source database, configuring an isolation level as a serialization isolation level, and closing automatic submission; starting a data detection transaction in the first database connection; acquiring total data of the source database at the current moment and first database log information; acquiring synchronized second database log information in a target synchronization system of the target database; based on the first database log information and the second database log information, obtaining a corresponding synchronization log from a source end synchronization system of the source database; analyzing the synchronization log into an SQL statement to be executed in a target database; acquiring total data of the target database after the execution is finished; performing data consistency detection based on the total data of the target database and the total data of the source database; and submitting a data detection transaction after the data consistency detection is completed.

Description

technical field [0001] The embodiments of the present disclosure relate to the field of database technology, and in particular, to a database data consistency detection method, a database data consistency detection device, a computer-readable storage medium and electronic equipment for realizing the database data consistency detection method. Background technique [0002] In the business scenario of applying a database, data is synchronized from the source database to the target database, and there are many links in the middle that may cause some data errors or missing. Therefore, it is necessary to check whether the source and target data are consistent during data synchronization. [0003] In related technologies, when comparing whether the data of the source end and the target end are consistent, it is usually to first lock the related business tables of the source database and the target database, and then perform comparison to realize data consistency detection. [000...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/23G06F16/27
CPCG06F16/2365G06F16/275
Inventor 魏乾黄海峰
Owner 北京人大金仓信息技术股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products