Realization method of fully distributed file index and cooperative editing mechanism

Abstract

The invention discloses a realization method of a fully distributed file index and cooperative editing mechanism. The realization method comprises the following steps of storing file folder information into a Swift storage medium in a Key-value dictionary file form, and changing a file folder operation into a file folder index file modification operation; performing file updating in a patch submitting manner; building an intermediate layer between an API (Application Program Interface) and Swift, and receiving a submitted patch file, wherein the intermediate layer is in charge of merging patches submitted to nodes; cooperatively merging all intermediate layer modes on a distributed segment tree, and obtaining patches merging all changes; and merging the original file and the patches to be used as the final version of the original file. The realization method has the advantages that a distributed high-stability file index system is provided; the file operation and the file folder operation are also unified; a set of off-line cooperative editing mechanism is provided; and the defects of poor file index support and file operation atomicity sacrifice due to complete distributed form pursuing by Openstack Swift are overcome.

Description

technical field [0001] The invention relates to the technical field of the Internet, in particular to a method for realizing a fully distributed file index and collaborative editing mechanism. Background technique [0002] Today, when the concept of "cloud" is so popular, applications such as cloud computing and cloud storage have become relatively mature, bringing convenience to people's lives. Cloud storage, which hosts data to the cloud by uploading, downloading or synchronizing, plays an important role in today's high network penetration rate due to its cross-platform, weak restriction and high reliability, which can save users from It eliminates the trouble of copying data between devices, and provides users with an important data backup warehouse that will not be lost or damaged. In this context, major commercial cloud storage services have emerged one after another, from Dropbox, GoogleDocs to domestic Baidu Netdisk, but the underlying technologies they rely on are a...

AI Technical Summary

Problems solved by technology

[0004] However, compared to other cloud storage projects, Swift still has the following deficiencies: 1. There are too few atomic operations. Swift only supports two atomic operations, read and write (overwrite). In comparison, Ceph supports Append and Truncate. Operation, combined with its weak consistency, it is difficult to store metadata files with modification requirements on Swift

2. The native file level support is poor. As a usable file system, folder support is essential

However, in Swift, folders are maintained through file name prefixes, resulting in no atomicity for batch operations on folders, resulting in a poor user experience

Then, increasing the atomic change operation of files while retaining the fully distributed and fully scalable characteristics of the algorithm represented by Openstack, and optimizing the processing method of the file system level have not yet been fully explored.

Images