Distributed data storage method and system based on multilayer consistent hashing

A technology of distributed data and storage systems, applied in the field of distributed storage systems, can solve problems such as poor load balancing and poor fault tolerance of distributed data storage systems

Active Publication Date: 2019-08-23
HERE DATA TECH
View PDF4 Cites 37 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The present invention provides a distributed data storage method and system based on multi-layer consistent hashing, which solves the problems of poor fault tolerance and poor load balance of the distributed data storage system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed data storage method and system based on multilayer consistent hashing
  • Distributed data storage method and system based on multilayer consistent hashing
  • Distributed data storage method and system based on multilayer consistent hashing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The present invention will be further described in detail below through specific embodiments in conjunction with the accompanying drawings. In the following implementation manners, many details are described for better understanding of the present application. However, those skilled in the art can readily recognize that some of the features can be omitted in different situations, or can be replaced by other elements, materials, and methods. In some cases, some operations related to the application are not shown or described in the description, this is to avoid the core part of the application being overwhelmed by too many descriptions, and for those skilled in the art, it is necessary to describe these operations in detail The related operations are not necessary, and the related operations can be fully understood according to the description in the manual and the general technical knowledge in the field.

[0025] In addition, the characteristics, operations or charact...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A distributed data storage method and system based on multilayer consistent hashing are provided. The system includes a plurality of storage nodes for providing data storage and redundancy protection;a plurality of management nodes for maintaining storage node attributes and virtual groups-storage node mapping information; a plurality of monitoring nodes for maintaining storage node state and processing state changes such as storage node addition, deletion, and failure; and one or more clients that provide storage system access points for applications or users. Storage nodes are organized ina tree structure, with each storage node in each layer of the tree being assigned with multiple identities and a hash space maintaining consisteny hash space. Instead of sharing a hash space between all storage nodes, multiple hash spaces in the storage node architecture tree that are consistent across each layer. The system guarantees the reliability and availability of the stored procedure and avoids the problem of load imbalance when accessing the system.

Description

technical field [0001] The invention relates to a distributed storage system, in particular to a distributed data storage system with fault tolerance and automatic load balancing. Background technique [0002] A distributed storage system stores data dispersedly on multiple independent devices. Traditional network storage systems mostly use centralized storage servers to store all data. Storage servers become the bottleneck of system performance and the focus of reliability and security, which cannot meet the needs of large-scale storage applications. The distributed network storage system adopts a scalable system structure, uses multiple storage servers to share the storage load, and uses location servers to locate and store information. It improves the reliability, availability and access efficiency of the system to a certain extent, but there are still the following question. [0003] A distributed storage system needs to use multiple servers to store data together. How...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08G06F16/13H04L12/26
CPCG06F16/137H04L43/10H04L67/1001G06F3/067G06F3/0617G06F3/0644G06F11/2094G06F3/0647G06F3/0673
Inventor 郝斌
Owner HERE DATA TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap