Data synchronization method and device, electronic equipment and storage medium
A data synchronization and data technology, applied in the computer field, can solve the problems of small data volume, data inconsistency, heavy database load, etc., and achieve the effect of shortening time, avoiding loss, and ensuring security.
Active Publication Date: 2020-10-13
BEIJING QIYI CENTURY SCI & TECH CO LTD
View PDF10 Cites 1 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
However, more and more real-time data query applications make the database unable to directly bring direct query results to customers, because the database load is getting heavier, and more systems cannot enjoy direct query results, so database synchronization technology came into being
[0003] At present, when using a database synchronization tool for database synchronization, the data synchronization tool will encounter data inconsistencies between the source database and the target database during the process of synchronizing data. Further repair and optimization of the database synchronization tool
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0065] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, but not all of them. Based on the embodiments in the present application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present application.
[0066] When using a database synchronization tool for database synchronization, the data synchronization tool will encounter the problem of data inconsistency between the source database and the target database during the process of synchronizing data. Further repair and optimization of the database synchronization tool. To this end, t...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention relates to a data synchronization method and device, electronic equipment and a storage medium. The data synchronization method comprises the following steps: when data entries in a source database are successfully synchronized to a target database, determining watermark data of the data entries according to the synchronization process of the successfully synchronized data entries, wherein the watermark data is used for performing synchronous historical process tracing; writing the watermark data of the successfully synchronized data entry into a memory buffer area by utilizing adata synchronization thread; and consuming the watermark data in the memory buffer area by utilizing the buffer area consumption thread, writing the watermark data in the memory buffer area into thepipeline file, and consuming the watermark data in the pipeline file by utilizing the pipeline consumption thread, and writing the watermark data in the pipeline file into the time sequence database.According to the embodiment of the invention, synchronous historical process tracing can be conveniently carried out according to watermark data; moreover, the watermark data is written into the memory buffer area firstly, so that the time for writing the watermark data can be shortened as much as possible, and the database synchronization speed is hardly influenced.
Description
technical field [0001] The present application relates to the field of computer technology, and in particular to a data synchronization method, device, electronic equipment and storage medium. Background technique [0002] Database synchronization technology is the core of application system processing. Not only does the application system need to add / delete / check operations to the database, but the data warehouse also needs to obtain different transaction data from many databases to improve its own data set. However, more and more real-time data query applications prevent the database from directly bringing direct query results to customers, because the database load is getting heavier and more systems cannot enjoy direct query results, so database synchronization technology has emerged as the times require. [0003] At present, when using a database synchronization tool for database synchronization, the data synchronization tool will encounter data inconsistencies between ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/27G06F16/25G06F16/23G06F21/16
CPCG06F16/27G06F16/254G06F16/2365G06F21/16Y02D10/00
Inventor 朱博帅
Owner BEIJING QIYI CENTURY SCI & TECH CO LTD