Method for constructing hierarchical catalogue based on consistent hashing data distribution

A technology for data distribution and consistency. It is used in electrical digital data processing, special data processing applications, instruments, etc. It can solve problems such as being unsuitable for file system applications, and achieve the effect of eliminating single points of failure and no performance bottlenecks.

Active Publication Date: 2012-12-12
华数传媒网络有限公司 +1
View PDF3 Cites 26 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The storage system based on consistent hashing has shown great advantages in terms of system scalability and load balancing. However, since this storage system has no directory hierarchy, it is a flat structure. In terms of data access, key Value correspondence, not suitable for traditional file system applications

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for constructing hierarchical catalogue based on consistent hashing data distribution
  • Method for constructing hierarchical catalogue based on consistent hashing data distribution
  • Method for constructing hierarchical catalogue based on consistent hashing data distribution

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The present invention will be further described below with reference to the drawings and specific embodiments.

[0038] Such as figure 1 The structure of the key-value file system based on consistent hashing is shown using the present invention. The bottom layer is a physical storage server, which is connected to physical storage hardware devices and forms physical storage directories such as / data1~ / dataX through the local file system XFS or EXT4. On the storage software server side, write a configuration file to map the physical storage directory, such as / data1, to a series of logical nodes. The configuration file format is as follows:

[0039] Physical catalog 1: Logical node number 1 Logical node number 2, ... Logical node number N

[0040] Physical catalog 2: Logical node number 1 Logical node number 2, ... Logical node number N

[0041] Among them, the value of N is configurable. Through this configuration file, different physical storage directories are virtualized i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for constructing a hierarchical catalogue based on consistent hashing data distribution. The method includes the steps: connecting a physical storage server with a storage hardware device to form / data1- / dataX physical storage catalogues through a local file system, and virtually turning the different physical storage catalogues into different logic storage nodes through a storage software server terminal; enabling the logic storage nodes and the physical storage catalogues to be in one-to-one mapping, and adjusting according to needs to realize dynamic migration; taking a logic storage volume as a unit to mount a file system by a storage client, wherein the logic storage volume consists of one or multiple logic storage nodes; and providing a global namespace through an access layer and data distribution of the client to enable physical storage catalogues of the constructed catalogue hierarchy on the physical storage server to be completely consistent with the global namespace of the client. The method has the advantages that uniformity of bottom physical storage and an upper logic structure is achieved to realize a hierarchical catalogue structure; and complete distribution of catalogue hierarchy is realized, single point of failure can be eliminated, and the like.

Description

Technical field [0001] The invention relates to a method for constructing a hierarchical directory on the basis of consistent hash data distribution. Background technique [0002] With the deepening and development of informatization, the scale of data is getting larger and larger, and the requirements for the scale of storage and the underlying architecture are getting higher and higher. Faced with such massive data storage, traditional servers can no longer meet the data storage requirements in terms of capacity and scalability, and network storage technology has gradually become the mainstream technology in the storage market. Compared with traditional storage systems, network storage systems have greater advantages in availability, availability, and cost. Compared with other storage technologies, the peer-to-peer storage system (P2P) based on consistent HASH has obvious advantages in availability, scalability and reliability, and is a hot spot in current storage technology r...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 程耀东何沛中赵志峰应必善陈靓邸鹏程永红
Owner 华数传媒网络有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap