Multistage-mapping-based large-scale multi-copy distributed storage system and application method thereof

A distributed storage and application method technology, applied in the application field of large-scale multi-copy distributed storage system, can solve the problems of unsupported copies and node weights, unbalanced data hashing, etc., to improve storage utilization and management costs The effect of improving and expanding the system capacity

Active Publication Date: 2014-06-11
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0012] The purpose of the present invention is to provide a set of application methods of a large-scale multi-copy distributed storage system based on multi-level mapping, to solve the unbalanced data hash in the large-scale distributed storage system existing in the prior art, which does not support copy and Node weight and other issues

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multistage-mapping-based large-scale multi-copy distributed storage system and application method thereof
  • Multistage-mapping-based large-scale multi-copy distributed storage system and application method thereof
  • Multistage-mapping-based large-scale multi-copy distributed storage system and application method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0058] Such as figure 1 As shown, a large-scale multi-copy distributed storage system based on multi-level mapping includes a storage node cluster used to store resources, a management node connected to the storage node cluster to manage the storage node cluster, and a hash mechanism to obtain The client of the resource storage location, and the rule node cluster that connects the management node and the client, accepts the management of the management node, and provides the client with hash mapping rules.

[0059] The following is a detailed description of each part of the system:

[0060] The storage node cluster is composed of all storage nodes. All resources in the system are stored on the storage nodes in the cluster. The storage node and the management node maintain a heartbeat of more than 1 minute to report their own conditions, that is, the disk Usage and current pressure, and accept the unified management of the management node.

[0061] The rule node cluster i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an application method of a multistage-mapping-based large-scale multi-copy distributed storage system. The problems of data hash imbalance, incapability of supporting copies and node weights, great difficulty in management and the like of the large-scale distributed storage system in the prior art are solved. The multistage-mapping-based large-scale multi-copy distributed storage system comprises a storage node cluster, a management node, a client and a regular node cluster, wherein the storage node cluster is used for storing resources; the management node and the client are connected with the storage node cluster respectively; the management node manages the storage node cluster; the client acquires the storage positions of the resources according to a hash mechanism; and the regular node cluster is connected with the management node and the client and managed by the management node, and provides hash mapping rules for the client.

Description

technical field [0001] The invention relates to an application method of a large-scale distributed storage system, in particular to an application method of a large-scale multi-copy distributed storage system based on multi-level mapping. Background technique [0002] With the increasing popularity of data-intensive applications, people need open storage and high-performance computing for more and more data, which puts forward strict requirements on the reliability and scalability of storage systems, and large-scale distribution The traditional storage system has been favored by people because of its relatively low price, good scalability and other advantages. Among them, the data hash mechanism is the core of the large-scale distributed storage system, which determines the storage layout of the data in the system, the utilization degree of the storage space, and the complexity of locating the data. [0003] The specific indicators to measure the performance of a data hashi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08
Inventor 段翰聪李林聂晓文詹文翰梅玫
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap