Data synchronization method, device and system

A data synchronization and data technology, applied in the field of data processing, can solve problems such as sorting

Active Publication Date: 2019-05-10
PEOPLE'S INSURANCE COMPANY OF CHINA
View PDF6 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] This application provides a data synchronization method to solve the problem of how t

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data synchronization method, device and system
  • Data synchronization method, device and system
  • Data synchronization method, device and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0126] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the application. However, the present application can be implemented in many other ways different from those described here, and those skilled in the art can make similar promotions without violating the connotation of the present application. Therefore, the present application is not limited by the specific implementation disclosed below.

[0127] The present application provides a data synchronization method, device and a data synchronization system. Each will be described in detail in the following examples.

[0128] The first embodiment of the present application provides a data synchronization method.

[0129] For ease of understanding, the actual application scenario of the data synchronization method is briefly described first. In practical applications, a message queue flow module and a data synchronization unit can be deployed on the computing...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data synchronization method, which comprises the following steps: obtaining to-be-synchronized data in a source database, and generating a first data change message for the to-be-synchronized data; determining a message theme of the first data change message according to a database table to which the to-be-synchronized data belongs in the source database; Pushing the first data change message into a first message queue which only comprises one partition and corresponds to the message theme according to the message theme; when a trigger condition is met, distributing the first data change message in the first message queue to a first partition of a second message queue according to a preset partition strategy; wherein the second message queue is used for the data synchronization unit to obtain the data change message and synchronize the to-be-synchronized data to the target database according to the data change message. The problem of how to more accurately andquickly synchronize the change data of the source database to the target database is solved.

Description

technical field [0001] The present application relates to the technical field of data processing, in particular to a data synchronization method, device and a data synchronization system. Background technique [0002] For industries with huge data scale and diversified business needs, the use of micro-service system to build a data processing system can adapt to the rapidly growing business needs and user volume. An existing data processing system constructed using a micro-service architecture includes a main system and multiple subsystems, wherein the main system processes the basic data based on the main system database used to store the basic data, and stores the main system database As the source database; each subsystem provides business services based on its own independent database, and the subsystem database is used as the target database; after the basic data of the source database changes, it needs to be synchronized to each target database in time to maintain data...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/27G06F9/54
Inventor 张娜鹿慧何栋黎锦康尚玲瑞李子旺于灏欧创新刘震杨猛
Owner PEOPLE'S INSURANCE COMPANY OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products