Data synchronization method, device and computer readable storage medium

A data synchronization and database technology, applied in the database field, can solve problems such as inability to meet data real-time requirements, conflicts, and inability to guarantee data consistency
CN110990435APending Publication Date: 2020-04-10MIAOZHEN INFORMATION TECH CO LTD
5 Cites 4 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
MIAOZHEN INFORMATION TECH CO LTD
Publication Date
2020-04-10

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The embodiment of the invention provides a data synchronization method, a data synchronization device and a computer readable storage medium, belongs to the field of databases and aims to synchronizedata to two different types of databases. The method comprises the following steps that: to-be-synchronized data in a first database are obtained, the to-be-synchronized data are written into a bufferpool; whether the quantity of the to-be-synchronized data in the buffer pool reaches a preset threshold value or not is judged every preset time; and if the quantity of the to-be-synchronized data inthe buffer pool reaches the preset threshold value, the to-be-synchronized data in the buffer pool are loaded to a second database in batches. The data are temporarily stored through the buffer pool;when the quantity of the to-be-synchronized data in the buffer pool reaches the preset threshold value, a database coprocessor is used for loading the to-be-synchronized data to the second database in batches; and therefore, the consistency of the data of different databases and the real-time performance of the synchronized data are guaranteed, and meanwhile data loss or data conflicts are avoided.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The present invention relates to the field of databases, in particular to a data synchronization method, device and computer-readable storage medium. Background technique

[0002] Various storage frameworks emerge in an endless stream in the Internet era, such as traditional relational databases: Oracle, MySQL, emerging NoSQL: HBase, Cassandra, Redis, full-text retrieval frameworks: ES (ElasticSearch), Solr, etc.

[0003] In the actual production process, two copies of data are usually stored and written into HBase and ES respectively; this may easily lead to data loss or data conflict, and cannot guarantee data consistency or meet data real-time requirements.

[0004] Based on the above problems, there is an urgent need for a data synchronization method that can ensure the consistency of data in different databases. Contents of the invention

[0005] In view of this, the object of the present invention is to provide a data synchronization method, d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More