Realization method of fully distributed file index and cooperative editing mechanism

A file indexing and fully distributed technology, applied in the Internet field, can solve problems such as no atomicity of folder batch operations, poor user experience, and difficulty in storing metadata files

Active Publication Date: 2016-03-16
WUXI TSINGHUA NAT LAB FOR INFORMATIONSCI & TECH INTERNET OF THINGS TECH CENT
View PDF6 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, compared to other cloud storage projects, Swift still has the following deficiencies: 1. There are too few atomic operations. Swift only supports two atomic operations, read and write (overwrite). In comparison, Ceph supports Append and Truncate. Operation, combined with its weak consistency, it is difficult to store metadata files with modification requirements on Swift
2. The native file level support is poor. As a usable file system,

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Realization method of fully distributed file index and cooperative editing mechanism
  • Realization method of fully distributed file index and cooperative editing mechanism
  • Realization method of fully distributed file index and cooperative editing mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0079] An implementation of updating the distributed line segment tree is as follows:

[0080] S105.1. Due to the update of the No. 0 internal patch, a certain node starts the distributed line segment tree update thread.

[0081] S105.2. The thread uses the formula i=(n<<1)+1 to calculate the node number of the distributed line segment tree corresponding to the middle layer node. and make it the current node.

[0082] S105.3. Use the formula parent(i)=(i^(i&-i))|((i&-i)<<1) to calculate the parent node of the current node, and update the patch data of the node. The specific method is as follows :

[0083] S105.3.1, collect the patch corresponding to the left and right child nodes of the node, if the child node is a leaf node, it means that it corresponds to an intermediate layer node, then take the No. 0 patch (total patch) of the intermediate layer node as its content; Otherwise take the patch corresponding to the tree node.

[0084]S105.3.2. If there is no patch in the l...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a realization method of a fully distributed file index and cooperative editing mechanism. The realization method comprises the following steps of storing file folder information into a Swift storage medium in a Key-value dictionary file form, and changing a file folder operation into a file folder index file modification operation; performing file updating in a patch submitting manner; building an intermediate layer between an API (Application Program Interface) and Swift, and receiving a submitted patch file, wherein the intermediate layer is in charge of merging patches submitted to nodes; cooperatively merging all intermediate layer modes on a distributed segment tree, and obtaining patches merging all changes; and merging the original file and the patches to be used as the final version of the original file. The realization method has the advantages that a distributed high-stability file index system is provided; the file operation and the file folder operation are also unified; a set of off-line cooperative editing mechanism is provided; and the defects of poor file index support and file operation atomicity sacrifice due to complete distributed form pursuing by Openstack Swift are overcome.

Description

technical field [0001] The invention relates to the technical field of the Internet, in particular to a method for realizing a fully distributed file index and collaborative editing mechanism. Background technique [0002] Today, when the concept of "cloud" is so popular, applications such as cloud computing and cloud storage have become relatively mature, bringing convenience to people's lives. Cloud storage, which hosts data to the cloud by uploading, downloading or synchronizing, plays an important role in today's high network penetration rate due to its cross-platform, weak restriction and high reliability, which can save users from It eliminates the trouble of copying data between devices, and provides users with an important data backup warehouse that will not be lost or damaged. In this context, major commercial cloud storage services have emerged one after another, from Dropbox, GoogleDocs to domestic Baidu Netdisk, but the underlying technologies they rely on are a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/13G06F16/134G06F16/16
Inventor 赵雷彧李振华肖贺朱彤
Owner WUXI TSINGHUA NAT LAB FOR INFORMATIONSCI & TECH INTERNET OF THINGS TECH CENT
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products