Data synchronization method and device and terminal equipment

A data synchronization and data technology, applied in the field of data processing, can solve problems such as large impact on computer resources, process blocking, abnormal exit, etc., to achieve the effect of ensuring accuracy, high availability, and solving the problem of timeliness

Pending Publication Date: 2020-02-04
CHINA PING AN PROPERTY INSURANCE CO LTD
View PDF0 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, the embodiments of the present invention provide a data synchronization method, device, and terminal equipment to solve the problem that data synchronization in the field of big data in t

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data synchronization method and device and terminal equipment
  • Data synchronization method and device and terminal equipment
  • Data synchronization method and device and terminal equipment

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0024] In the following description, specific details such as specific system structures and technologies are presented for the purpose of illustration rather than limitation, so as to thoroughly understand the embodiments of the present invention. It will be apparent, however, to one skilled in the art that the invention may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.

[0025] The technical solutions of the present invention are illustrated below through specific examples.

[0026] refer to figure 1 , which shows a schematic flow chart of the steps of a data synchronization method according to an embodiment of the present invention, which may specifically include the following steps:

[0027] S101, using a preset OGG tool to construct a data link between the so...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention is suitable for the technical field of data processing, and provides a data synchronization method and device and terminal equipment, and the method comprises the steps: building a data link between a source database and a target database through employing a preset OGG tool; generating a plurality of data transmission channels between a source database and a targetdatabase based on the data link; when an operation behavior for any data in a source database is detected, analyzing the operation behavior into a byte stream, wherein the byte stream carries time information of the operation behavior; and transmitting the byte stream to a target database through a plurality of data transmission channels, wherein the target database is used for compiling the bytestream into an operation behavior and replaying the operation behavior in the target database based on the time information so as to realize data synchronization. According to the embodiment, the problems that during data consistency processing of a big database, influences of computer resources are large, and timeliness is low are solved.

Description

technical field [0001] The invention belongs to the technical field of data processing, and in particular relates to a data synchronization method, a data synchronization device, a terminal device and a computer-readable storage medium. Background technique [0002] In the field of distributed storage, in order to increase the high availability of the system, multiple copies of the same data are often stored. But this approach also brings the problem of data consistency. Data consistency means that the result of transaction execution must be to change the database from one consistent state to another. Guaranteeing data consistency enables all data to have a consistent state when a transaction completes. [0003] In the prior art, data consistency processing in the field of big data is mostly implemented in a synchronous manner of batch processing and multi-thread fetching. For example, for a sqoop (a batch data migration tool) process, it can be divided into multiple thre...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/27
CPCG06F16/275
Inventor 丁永郑泽宏
Owner CHINA PING AN PROPERTY INSURANCE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products