Data synchronization method, device and equipment and computer readable medium

A data synchronization and data technology, applied in the field of data processing, can solve the problem of high coupling between data synchronization function and business function, and achieve the effect of ensuring final consistency, easy maintenance and iteration

Pending Publication Date: 2020-12-25
JINGDONG TECH HLDG CO LTD
View PDF2 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] This application provides a data synchronization method, device, equipment and computer-readable medium to solve the technical problem of high coupling between data synchronization function and business function

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data synchronization method, device and equipment and computer readable medium
  • Data synchronization method, device and equipment and computer readable medium
  • Data synchronization method, device and equipment and computer readable medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, but not all of them. Based on the embodiments in the present application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present application.

[0029] In the following description, use of suffixes such as 'module', 'part' or 'unit' for denoting elements is only for facilitating the description of the present application and has no specific meaning by itself. Therefore, "module" and "component" may be mixedly used.

[0030] First of all, some nouns or terms appearing in the pro...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a data synchronization method, device and equipment and a computer readable medium. The method comprises the steps that a target transaction log of a first data storage end ismonitored, the first data storage end is used for storing data generated by operation of a business system, and the target transaction log is used for recording data updating information generated bythe first data storage end; when it is detected that the target transaction log is updated, target update data in the target transaction log is extracted; and the target update data is written into the second data storage end according to a preset configuration strategy so as to synchronize the target update data to the second data storage end. According to the invention, which data is updated and updated can be determined through the binary log file of the source data storage end, so that the target data storage end can directly perform data synchronization without the indication of a service function module, and the data synchronization and the service function are completely decoupled; maintenance and iteration of the two systems are facilitated, and stability is not influenced by eachother.

Description

technical field [0001] The present application relates to the technical field of data processing, and in particular to a data synchronization method, device, equipment and computer-readable medium. Background technique [0002] Data synchronization refers to synchronizing data from one storage medium to another. The two storage media may be the same or different, such as from MySQL to Elasticsearch, from MySQL to HBase, from MySQL to Elasticsearch and HBase, etc. Data synchronization can be internal Business logic trigger or external trigger. Business logic trigger: For example, when the data bizType=1, the data is synchronized from one MySQL database to another MySQL database, and when the data bizType=2, the data is synchronized from MySQL to HBase. External trigger: For example, a scheduled task at 3 am every day synchronizes the full amount of data in a table in MySQL to an index in Elasticsearch. [0003] At present, in related technologies, the data to be synchronize...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/23G06F16/27
CPCG06F16/2365G06F16/27
Inventor 孙亮
Owner JINGDONG TECH HLDG CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap