Data synchronization method and system

A data synchronization and data storage system technology, applied in the field of data synchronization methods and systems, can solve problems such as system performance degradation, complex design, and difficulty in building new data copies, and achieve the effects of reduced service performance and reduced bandwidth costs.

Active Publication Date: 2014-05-07
TENCENT TECH (SHENZHEN) CO LTD +1
View PDF5 Cites 32 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] (2) Complex design
The two systems are equally important. In order to ensure normal external services, when one system is abnormal, it will affect the normal service of the other system. This design directly leads to an increase in operation and maintenance costs;
[0007] (3) It is difficult to build a new data copy
[0008] (4) The more data copies, the worse the performance
When there are more data copies available, the failure to update a certain data copy will cause more write operations to be judged invalid, resulting in system performance degradation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data synchronization method and system
  • Data synchronization method and system
  • Data synchronization method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] Embodiments of the present invention provide a data synchronization method and system.

[0026] In order to make the object, technical solution and advantages of the present invention clearer, the implementation manner of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0027] Please refer to figure 1 , figure 1 A flow chart of a data synchronization method provided by an embodiment of the present invention; figure 2 It is a system architecture connection diagram in a data synchronization method provided by an embodiment of the present invention; please also refer to figure 1 and figure 2 , the method includes:

[0028] Step S101: writing external update data into the first data storage system;

[0029] When the user has a write operation, the service process writes the user's updated data into the first data storage system. Among them, the service process is a module that provides users with servic...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiments of the invention disclose a data synchronization method and system. The data synchronization method comprises the following steps: writing external updating data into a first data storage system; recording writing operation and generating a binary system log; respectively writing the binary system log into a buffer pool and the binary system log file of a disk; and when the updating data is synchronized, searching for a binary system log corresponding to the updating data from the buffer pool, and sending the binary system log to a second data storage system for data synchronization. The embodiments of the invention bring forward an asynchronous transmission synchronization strategy based on a buffer pool and a binary system log file, a data storage system and a data synchronization system are separated, the data synchronization system is in charge of copying each data for updating to a latest state according to a binary system log, under such a mode, the system servicing performance is not reduced at all, and the system overall complexity, coupling and bandwidth cost are substantially reduced.

Description

technical field [0001] The invention relates to the technical field of data storage and transmission, in particular to a data synchronization method and system. Background technique [0002] UGC (User Generated Content, user-generated content) is a new way for users to use the Internet, that is, from the original download-based to download and upload. Social networking, video sharing and blogging are the main application forms of UGC. With the continuous development of the global Internet business, the UGC business is rising day by day, which has aroused widespread concern in the industry. [0003] For safe operation, a disaster recovery solution will be introduced during system design. The disaster recovery solution requires the system to have at least two complete data copies available. Each data copy is independent of each other in deployment and can provide full real-time services. When one of the data When an abnormality or disaster occurs in the copy and the data cop...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
CPCG06F3/065G06F11/2058G06F11/2074G06F16/184G06F16/172G06F16/1815G06F16/27G06F16/2365
Inventor 江兴才田明刘里黄利华李钟伟
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products