Distributed-data management method

A distributed data and management method technology, applied in the field of distributed data storage, can solve problems such as insufficient reliability of data copy distribution, system resource and performance limitations, etc., to eliminate resource and performance bottlenecks, reduce the number of memory accesses, and improve reliability. The effect of scalability

Inactive Publication Date: 2017-10-24
HUAZHONG UNIV OF SCI & TECH
View PDF4 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] Aiming at the above defects or improvement needs of the prior art, the present invention provides a distributed data management method, the purpose of which is to disperse the metadata management function of distributed data management to multiple nodes and establish a mapping relationship; Metadata copies and file data copies ensure that the copies are distributed to different nodes. When reading and writing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed-data management method
  • Distributed-data management method
  • Distributed-data management method

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0028] In order to make the objectives, technical solutions, and advantages of the present invention clearer, the following further describes the present invention in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.

[0029] Some definitions will be used in the embodiments of the present invention, and the terms in them are explained as follows:

[0030] Storage end: the node used to store data in distributed data management;

[0031] Such as figure 1 As shown, the purpose of the present invention is to disperse the metadata management function of distributed data management to multiple nodes and establish a mapping rel...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed-data management method and belongs to the field of distributed storage. The technical scheme includes that scattering metadata management functions to multiple nodes, creating mapping relations, selecting an implementation structure that a common multi-fork tree and a hash table are combined in metadata tree structure design, adding full path fields to the data structure of metadata, and writing new data prior to logs in data writing; after file metadata is acquired, acquiring the storage location of file data in a mapping mode; meanwhile, supporting file metadata copies and file data copies, adopting the different mapping relations to ensure that the copies are distributed to the different nodes when the file metadata copies or the file data copies are used, and enabling a copy storage terminal to take over a main storage end in operation rapidly when the file metadata or the file data is written and the main storage end fails. By the arrangement, performance and reliability of distributed data management can be effectively improved.

Description

technical field [0001] The invention belongs to the field of distributed data storage, and more specifically relates to a distributed data management method. Background technique [0002] Distributed data management refers to accessing data on other nodes through the network in a manner similar to a local file system. [0003] Accessing a file actually corresponds to accessing each block of the file. After obtaining the metadata information of the file, it is necessary to continue to obtain the block information of the file. The traditional method is based on the block distribution table, that is, a block distribution table is maintained in the memory, and the storage location of the file blocks is stored in the table, and the file block information is obtained by querying the block distribution table. [0004] When accessing a file, the metadata information of the file is obtained first, and then the corresponding file data is accessed. Metadata refers to data describing ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/134G06F16/152G06F16/178G06F16/182
Inventor 万胜刚曾良咀方俊涛
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap