Log synchronization method and device, storage medium and electronic equipment

A log and transaction technology, applied in the field of data processing, can solve problems such as data synchronization delay, data synchronization time extension, difficult data source data consistency, etc., to achieve the effect of increasing speed, reducing memory loss, and avoiding full synchronization

Active Publication Date: 2019-07-16
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF10 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the above two methods have corresponding shortcomings: first, for MySql, relying on the synchronization mechanism provided by MySql itself, when the load pressure on the source database is high, it will cause data synchronization delay; for Redis, use Redis data During synchronization, when the primary node is replaced or the log buffer range of the primary node is exceeded, full data synchronization will occur,

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log synchronization method and device, storage medium and electronic equipment
  • Log synchronization method and device, storage medium and electronic equipment
  • Log synchronization method and device, storage medium and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details being omitted, or other methods, components, devices, steps, etc. may be adopted. In other instances, well-known technical solution...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a log synchronization method and device, and belongs to the technical field of data processing. The method comprises the following steps: reading a transaction log from a source database and storing the transaction log into a plurality of read annular queues; storing the transaction logs in the read annular queues into a consumption annular queue, and sending the transaction logs in the consumption annular queue to a thread connected with a target database; and writing the transaction log into the target database by the thread and recording a log code corresponding tothe successfully written transaction log. According to the method, the annular queue is adopted to store the transaction logs, so that the transaction log storage speed is increased, and the memory loss is greatly reduced.

Description

technical field [0001] The present disclosure relates to the technical field of data processing, and in particular, to a log synchronization method, a log synchronization device, a computer-readable storage medium, and electronic equipment. Background technique [0002] With the development of Internet technology, more and more users use the Internet. In order to ensure the stability of the system, the deployment structure of the system has also begun to change from the initial deployment of a single computer room to the deployment of multiple computer rooms in the same city and remote multi-computer rooms. . When the system is deployed in multiple computer rooms, the generated data will also be distributed in multiple computer rooms, which also brings great challenges to data synchronization among multiple computer rooms. [0003] Currently, there are two ways to keep data synchronized: one is to rely on the synchronization mechanism provided by the data source software it...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/27G06F16/18
CPCG06F16/1815G06F16/27
Inventor 李强廖耀华
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products