Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data replication method and device

A data replication and data technology, applied in the field of data processing, to achieve the effect of high availability and high fault tolerance, saving transmission times, and saving network traffic

Active Publication Date: 2014-02-05
珠海多玩信息技术有限公司
View PDF5 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the same update data is recorded in the log events of the two servers, resulting in the log event recording the same update data being transmitted multiple times, resulting in double network traffic
In addition, the MySQL master-master replication technology provided by the existing technology only realizes data replication between two servers, which is powerless in the face of massive Internet data services

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data replication method and device
  • Data replication method and device
  • Data replication method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0059] Combining the above and figure 1 In the schematic diagram of the implementation environment shown, in order to achieve high availability and high fault tolerance of data and services in the face of Internet massive data services under the condition of saving the number of transmissions of log events and network traffic, this embodiment provides A method of data replication. see figure 2 , the method flow provided by this embodiment is specifically as follows:

[0060] 201: Obtain log events with updated data recorded from one or more servers in the local replication group;

[0061] As a preferred embodiment, after acquiring log events with updated data from one or more servers in the local replication group, it also includes:

[0062] Record the status information of log events obtained from one or more servers in the local replication group, and the status information includes at least the node ID, log file name, log file offset and current status information of on...

Embodiment 2

[0080] This embodiment provides a method for data replication. For the convenience of description, this embodiment combines the content of the first embodiment above, as follows figure 1 The implementation environment shown is taken as an example, and the method provided in this embodiment is described in detail. see image 3 , the method flow provided by this embodiment is specifically as follows:

[0081] 301: Obtain log events with updated data recorded from one or more servers in the local replication group;

[0082] For this step, the local replication group is the replication group where the execution subject of the method provided by this embodiment is located. by figure 1 The method in which synchronization node 1 executes data replication in the illustrated implementation environment is taken as an example, and the local replication group is the replication group where synchronization node 1 is located. There is a replication relationship between one or more serve...

Embodiment 3

[0150] This embodiment provides a data replication device, which is used to implement the data replication method provided in the first or second embodiment above, see Figure 4 , the device consists of:

[0151] The first acquisition module 401 is configured to acquire log events recorded with updated data from one or more servers of the local replication group;

[0152] A storage module 402, configured to store the obtained log event in the relay log of the local replication group;

[0153] The first update module 403 is used to update the version number of the relay log of the local replication group;

[0154] The second obtaining module 404 is used to obtain the relay logs of other replication groups and the version numbers of the relay logs of other replication groups. The relay logs of other replication groups store information obtained from one or more servers of other replication groups Log events with updated data;

[0155] A selection module 405, configured to sel...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data replication method and device and belongs to the field of data processing. The method comprises the steps that log events with updated data recorded are obtained from one or more servers from a local replication group; the obtained log events are stored in relay logs in the local replication group; the version number of each relay log of the local replication group is updated, relay logs of the other replication groups and the version number of each relay log of the other replication groups are obtained, and log events with updated data recorded are obtained from one or more servers from the other replication groups and stored in the relay logs of the other replication groups; according to the version number of each relay log, relay logs are selected from the relay logs of the local replication group and from the relay logs of the other replication groups according to the version number of each relay log, and the data of one or more servers of the local replication group are updated according to the selected relay logs. The data replication method and device can reduce transmission frequency of the log events and network flow, and achieves high availability and high fault tolerance of the data and services.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a data replication method and device. Background technique [0002] With the continuous development of Internet technology, the types and quantities of Internet services are also increasing. In order to effectively manage Internet services, servers implementing Internet services are generally hosted in an IDC (Internet Data Center, Internet Data Center) computer room of an operator. However, the network connectivity between the current IDC computer rooms is not very good, and a large number of packet loss problems often occur. In order to solve this problem, the data of one server is copied to other servers, so that after the failure of the server, other servers can be switched to continue working. Among them, the server used to copy data is called a slave server, and the server whose data is copied is called a master server. [0003] When implementing data replication in the pr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L12/24H04L29/08
Inventor 喻先兵
Owner 珠海多玩信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com