Method and system for managing data of cluster storage system

A data management system and cluster storage technology, applied in the data management method and system field of cluster storage system, can solve the problems of design complexity, performance overhead, metadata synchronization consistency, etc., achieve system concurrency and performance linear expansion, increase, eliminate The effect of performance bottleneck and system scalability improvement

Active Publication Date: 2013-01-02
北京联创信安科技股份有限公司
View PDF5 Cites 46 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] Although the distributed metadata service model solves the problems existing in the centralized data service model, it also introduces problems such as design complexity, performance overhead, and metadata synchronization consistency.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for managing data of cluster storage system
  • Method and system for managing data of cluster storage system
  • Method and system for managing data of cluster storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The present invention will be further described below in conjunction with drawings and embodiments.

[0029] figure 2 It is a flow chart of the data management method of the cluster storage system according to the embodiment of the present invention. Such as figure 2 As shown, the method is implemented based on a system including a client and a storage server cluster, including data storage and access operations, and the data storage operations include:

[0030] The disk file system is used to store metadata, and the data layout is distributed based on the directory as the basic unit and the Hash range is allocated; the parent directory of the disk file system file uses extended attributes to record the mapping relationship of the storage nodes, and the child files are distributed among the storage nodes to which the parent directory belongs ; The method performs a data access operation based on the data layout.

[0031] Wherein, the method further includes the ope...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a system for managing data of a cluster storage system and belongs to the technical field of cluster storage. The method includes that a disk file system is used for storing and managing meta data, and the data are distributed by using a catalogue as a basic unit; a client senses data distribution information and sends a data access instruction, a storage server judges whether a finding path is a root catalogue according to the data access instruction of the client, a specific active node is selected to be a target node for data access if the finding path is the root catalogue, otherwise, a Hash value is calculated according to path input parameters to obtain the data distribution information, and finding the target node for data access. According to the method and the system for managing the data of the cluster storage system, a series of relevant problems of performance bottlenecks, single point faults, data inconsistency and the like of meta data management are eliminated, system expansibility is obviously improved, and linear expansion increase of system concurrency and performances is achieved.

Description

technical field [0001] The invention relates to the technical field of cluster storage, in particular to a data management method and system of a cluster storage system. Background technique [0002] Under the background of cloud storage and big data, unstructured data has shown explosive growth. In the face of massive storage systems, efficient metadata management and data location are huge challenges, which directly affect system scalability, performance, reliability and stability etc. [0003] Existing technical solutions mainly use dedicated metadata services to manage metadata, including centralized and distributed models, and data location is realized by querying metadata servers. figure 1 It is a schematic diagram of the metadata service model in the prior art, such as figure 1 as shown, figure 1 (a) It is a centralized metadata service model. This model provides a central metadata server responsible for metadata storage and client query requests. It provides a uni...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 刘爱贵
Owner 北京联创信安科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap