Data replication method and device and computer storage medium

A data replication and data block technology, applied in database distribution/replication, computer components, computing, etc., can solve the problems of high network overhead and high network bandwidth, and achieve the effects of low search overhead, high search efficiency, and small search space

Pending Publication Date: 2022-05-06
HUAWEI TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] This application provides a data replication method and device, and a computer storage medium, which can solve the current problems of high network bandwidth and large network overhead required for data replication

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data replication method and device and computer storage medium
  • Data replication method and device and computer storage medium
  • Data replication method and device and computer storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] In order to make the purpose, technical scheme and advantages of the application clearer, the embodiment of the application will be further described in detail below in combination with the accompanying drawings.

[0030] In order to facilitate readers' understanding of the scheme of this application, some terms are first explained below.

[0031] Volume: the volume in the embodiment of the application should be understood in a broad sense, which can be either a physical hard disk (such as disk, memory stick, solid-state disk or other nonvolatile storage medium), or a partition in the hard disk, or a logical space virtualized from the physical space provided by the hard disk, such as logical volume.

[0032] Data block: refers to the basic unit of data processing. In the storage system, the data is usually cut into fixed length blocks to facilitate system processing. The length of data block is usually 8 kilobytes (k), 16K, 32K or 64K.

[0033] Snapshot: refers to a fully a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data replication method and device and a computer storage medium, and belongs to the field of data storage. A first storage device obtains a modified data block of a first snapshot of a logical volume of the first storage device for a second snapshot of the logical volume, and determines a target data segment in the second snapshot according to a target storage address of the modified data block in the logical volume, then, similar data blocks corresponding to the modified data blocks are searched in the target data segments, and when the target data segments contain the similar data blocks corresponding to the modified data blocks, the modified data blocks are sent to the target data segments; and the first storage device sends storage address description information containing the similar data blocks and copy information of difference information of the modified data blocks relative to the similar data blocks to the second storage device. The data volume of the copy information sent by the first storage device to the second storage device is smaller than the data volume of the modified data block, so that the network bandwidth occupied by the modified data in the transmission incremental data is reduced, and the network overhead is reduced.

Description

technical field [0001] The application relates to the field of data storage, in particular to a data replication method and device and a computer storage medium. Background technology [0002] With the increase of data scale and the demand for data reliability and consistency, data replication technology is particularly important in the field of data storage. Data replication system usually includes master storage device and slave storage device. The master storage device generates a snapshot every interval and copies the snapshot to the slave storage device to make the data stored by the slave storage device consistent with the data stored by the master storage device. Among them, each snapshot corresponds to a fingerprint table. Multiple fingerprints are stored in the fingerprint table, and each fingerprint can be the hash value of a data block, which is used to identify the data block. The fingerprints of two data blocks are different, indicating that the two data blocks are d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2455G06F16/2453G06F16/27G06K9/62G06F9/54
CPCG06F16/2455G06F16/2453G06F16/275G06F9/543G06F18/22
Inventor 黄增士潘浩刘中全王晨
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products