Distributed file system oriented to access and application of multiple data types

A technology of distributed files and data types, applied in special data processing applications, electrical digital data processing, instruments, etc., can solve the problems that the traditional metadata design mode cannot solve, and achieve the improvement of data retrieval speed, system load capacity improvement, etc. The effect of increased throughput

Active Publication Date: 2014-07-23
HUAZHONG UNIV OF SCI & TECH
View PDF3 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] In view of the diversification of the underlying data access modes of the above-mentioned file system, the problems that cannot be solved by the traditional metadata design mode caused by the above-mentioned file system, the present invention introduces a distributed file system oriented to multi-data type access applications to solve the problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed file system oriented to access and application of multiple data types
  • Distributed file system oriented to access and application of multiple data types
  • Distributed file system oriented to access and application of multiple data types

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

[0035] The metadata in the existing file system design can only implement simple indexing functions without classifying the metadata. The data storage mode of the entire system has been determined in advance according to the system requirements and cannot adapt to dynamic changes.

[0036] When storing files in the system, it is only necessary to visit the main node, find free blocks, store the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed file system oriented to access and application of multiple data types. A master node of the distributed file system comprises various kinds of metadata wherein each kind of metadata comprises a metadata hash table and a corresponding metadata control structural body. Every kind of metadata corresponds to the corresponding data type, and the data types are classified according to the access characteristics of the data. Every kind of metadata control structural body is used for conducting classified management according to the corresponding data type. When the system receives an application program accessing request, the metadata control structural body of the corresponding type is determined according to the type of files needing to be accessed in the application process accessing request, the information of the metadata control structural body of the corresponding type is returned to an application program, and therefore the application program can conduct corresponding file operation on a corresponding data storage node according to the control information. According to the distributed file system oriented to access and application of the multiple data types, the data retrieval speed is doubly improved, the load capacity of the system is obviously improved, and the scalability is good.

Description

technical field [0001] The invention belongs to the technical field of computer storage, and more specifically relates to a distributed file system oriented to multiple data type access applications. Background technique [0002] With the continuous innovation of information technology and the continuous improvement of informatization level, people's demand for computing power and storage capacity has shown explosive growth. Applications need to store PB and TB-level data. Even if more computing nodes, more disks and processors are added, fast enough computing cannot be provided, because file access speed becomes the main bottleneck. Metadata is data used to describe the characteristics of a file system and plays a vital role in data operations, so the design of metadata becomes the key. [0003] At present, the research on metadata is focused on how to organize metadata, so that the metadata can be positioned quickly, and finally the efficient access of data can be realize...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/182
Inventor 郑然周庭哲金海章勤
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products