Unlock instant, AI-driven research and patent intelligence for your innovation.

Asynchronous distributed object uploading for replicated content addressable storage clusters

A distributed data and object technology, applied in the direction of special data processing applications, instruments, file access structures, etc., can solve the problems of long delay, upload time, client and/or server failure exacerbation, etc.

Active Publication Date: 2015-06-17
GOOGLE LLC
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This process can create long delays in upload times that can be exacerbated by potential client and / or server failures

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Asynchronous distributed object uploading for replicated content addressable storage clusters
  • Asynchronous distributed object uploading for replicated content addressable storage clusters
  • Asynchronous distributed object uploading for replicated content addressable storage clusters

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The following detailed description refers to the accompanying drawings. The same reference numbers in different drawings may identify the same or similar elements. Also, the following detailed description does not limit the invention.

[0022] The systems and / or methods described herein can provide an asynchronous distributed object upload algorithm in streaming mode for a replicated storage cluster that provides availability, liveness, and consistency guarantees for large immutable objects. Objects can be divided into chunks that are asynchronously uploaded by applications to available clusters. Implementations described herein may use the underlying replication layer of a distributed multi-master data replication system to replicate chunks in a content addressable index (also referred to herein as a "global index") between different storage clusters Location. Once the object is applied, a unique content handle (eg, hash value or digital signature) can be calculated...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A method is performed by two or more devices of a group of devices in a distributed data replication system. The method includes receiving, at the two or more devices, a group of chunks having a same unique temporary identifier, where the group of chunks comprises an object to be uploaded; creating an entry for the object in a replicated index, where the entry is keyed by the unique temporary identifier, and where the replicated index is replicated at each of the two or more devices; and determining, by an initiating device of the two or more devices, that a union of the group of chunks contains all data of the object. The method also includes calculating a content-based identifier to the object; creating another entry for the object in the replicated index, where the other entry is keyed by the content-based identifier; and updating the replicated index to point from the unique temporary identifier to the content-based identifier.

Description

Background technique [0001] The enterprise computing landscape has undergone a fundamental shift in storage architecture in that centralized server architectures have given way to distributed storage clusters. As businesses look for ways to increase storage efficiency, storage clusters built from commodity computers can deliver high performance, availability and scalability to new data-intensive applications at a fraction of the cost compared to single-disk arrays. To unlock the full potential of a storage cluster, data is replicated across multiple geographic locations, thereby increasing availability and reducing network distance to clients. [0002] In such a system, distributed objects and references are created, cloned, and deleted dynamically across different clusters (using a multi-master model), and the underlying data replication layer maintains write-order fidelity so that all clusters write in the same The view for is finished. [0003] Some current visualization,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
CPCG06F16/13G06F16/184G06F16/273
Inventor 亚历山大·德罗贝切夫亚历山大·克塞尔曼
Owner GOOGLE LLC