Synchronization method and device for cloud storage system

Abstract

The invention discloses a synchronization method and device for a cloud storage system. The method comprises the following steps: receiving a file object operation request initiated by a client; creating the content of the request according to a file object, and calculating a hash value corresponding to the file object; obtaining a partition where the file object is located according to the hash value; obtaining the storage equipment corresponding to each copy of multiple file objects according to the partition where the file object is located; initiating write requests to the obtained multiple storage equipment to write the copies of the file objects into the corresponding storage equipment; and calculating the hash values of new partitions and transmitting the new hash values to the adjacent next storage equipment. According to the synchronization method and device disclosed by the application, the network overhead and synchronization delay for synchronizing the file objects can be reduced.

Description

technical field [0001] The present application relates to the field of cloud storage, in particular to a synchronization method and device for a cloud storage system. Background technique [0002] Cloud storage services provide users with a mechanism to access files on the network at any time. With the explosive growth of Internet data volume, how to efficiently, reliably and stably store these data has become very urgent, so cloud storage has also become a research hotspot in the field of network storage. [0003] The existing object storage system (object storage system) using the eventual consistency model is a combination of the advantages of Network Attached Storage (Network Attached Storage, NAS) and Storage Area Network (Storage Area Network, SAN). The cloud storage system has the advantages of high-speed direct access of SAN and data sharing of NAS at the same time. It is a storage architecture with high reliability, cross-platform and safe data sharing. The object...

AI Technical Summary

Problems solved by technology

The object storage system is an important component of building a cloud computing system, but the existing object storage system has a lot of bandwidth consumption and high time delay problems that need to be solved

In addition, a huge amount of money is needed to purchase routers and switches, etc. to complete the construction of network infrastructure

[0004] On the other hand, existing object storage systems take a long time to achieve a consistent state of file synchronization

Therefore, for a large-scale system, the system consumes a lot of computing resources to copy the file objects in each storage endpoint to other storage nodes

This will lead to a delay in the execution of user-side instructions, and such a time delay will lead to a poor user experience

Similarly, for data-intensive object storage systems, data synchronization processing often has significant delays, and a large amount of network overhead becomes unacceptable

Images