Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and server for replicating data in distributed storage environment

A technology of distributed storage and server, applied in the field of communication network

Active Publication Date: 2019-06-25
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Embodiments of the present invention provide a method and server for replicating data in a distributed storage environment, to solve or alleviate one or more of the above technical problems in the background technology, and at least provide a beneficial option

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and server for replicating data in distributed storage environment
  • Method and server for replicating data in distributed storage environment
  • Method and server for replicating data in distributed storage environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] An embodiment of the present invention provides a method for replicating data in a distributed storage environment. Such as figure 1 Shown is a flowchart of a method for replicating data in a distributed storage environment according to an embodiment of the present invention. The method for duplicating data under the distributed storage environment of the embodiment of the present invention comprises the following steps:

[0031] S101. Obtain a copy request stored in the message middleware; the copy request includes a source area address, a source hash bucket (bucket) and a source object (object).

[0032] The execution subject of the embodiment of the present invention is the replication execution unit (Replication Worker). The replication execution unit can exist in the object storage system of the source area, can also exist in the object storage system of the target area, and can also exist in other objects in the object storage system. On the node, there is no li...

Embodiment 2

[0039] Embodiment 2 of the present invention provides a method for replicating data in a distributed storage environment. Such as figure 2 Shown is a flowchart of a method for replicating data in a distributed storage environment according to an embodiment of the present invention. The method for duplicating data under the distributed storage environment of the embodiment of the present invention comprises the following steps:

[0040] S201. Obtain a copy request stored in the message middleware; the copy request includes a source area address, a source hash bucket, and a source object.

[0041] S202. Store the source area address, source hash bucket and source object as a record in the database.

[0042]The database involved in the embodiments of the present invention can store data according to a relational model, and provide transaction guarantees of atomicity, consistency, isolation and durability (the four basic elements for correct execution of database transactions, ...

Embodiment 3

[0053] Embodiment 3 of the present invention provides a server. Such as Figure 4 Shown is a schematic diagram of a server according to an embodiment of the present invention. The server of the embodiment of the present invention includes:

[0054] The obtaining module 41 is configured to obtain a copy request stored in the message middleware; the copy request includes a source area address, a source hash bucket and a source object;

[0055] The sending module 42 is configured to send the copy request to the object storage system in the target area, so that the object storage system in the target area sends the copy request to the source area according to the source area address, the source hash bucket, and the source object in the copy request. The object storage system of the object storage system initiates the operation of obtaining the replicated data.

[0056] Further, the copy request stored in the message middleware is stored when there is a copy request in the objec...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method and server for replicating data in a distributed storage environment. The method comprises the steps that a replication request stored in message middleware is obtained; the replication request comprises a source area address, a source hash bucket, and a source object; the replication request is sent to an object storage system of a target area, so that an operationof obtaining replicated data is initiated to the object storage system of a source area by the object storage system of the target area according to the source area address, the source hash bucket and the source object in the replication request. According to the method, it is guaranteed that the replication request is not blocked by using the message middleware to store the replication request,orderly execution of the message is guaranteed by the message middleware, messages are put into a message queue by the message queue in the message middleware according to an order in which the messages are issued, and a replication task is performed according to the order in which the messages are issued, thereby guaranteeing that the replication task which is generated first is performed first.

Description

technical field [0001] The invention relates to the technical field of communication networks, in particular to a method and server for replicating data in a distributed storage environment. Background technique [0002] In cloud computing services, object storage service is a very important basic service. The object storage service writes data as objects in the user's storage area, and the user can write, read, and delete objects in the storage area. In an existing object storage system, the maximum data size of a single object that can be supported is 5T. When a traditional object storage system stores data, it usually divides the data into small pieces for storage, and uses metadata to maintain the relationship between the object and each small piece of data. In an object storage system, when a user needs to perform a copy operation, the traditional technology is direct copy. [0003] However, when the object data is large, it sometimes even involves the replication of...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/0619G06F3/065G06F3/067
Inventor 贾宝雷施黄骏段立国
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD