Distributed file system and file processing method thereof

A distributed file and file processing technology, applied in the direction of electrical digital data processing, special data processing applications, electrical components, etc., can solve problems such as performance bottlenecks, achieve the effects of improving utilization, solving performance bottlenecks, and releasing storage space

Active Publication Date: 2009-09-02
ZTE CORP
View PDF0 Cites 42 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The client's access to the file system involves the operation of metadata, that is, the relationship between the client and the metadata server is many-to-one. Therefore, the metadata server can easily become the performance bottleneck of the entire system; in IPTV (interactive This problem is especially obvious when a large number of users concurrently access certain content in application scenarios that are prone to hotspots, such as network TV)

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed file system and file processing method thereof
  • Distributed file system and file processing method thereof
  • Distributed file system and file processing method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] Below in conjunction with accompanying drawing and embodiment the present invention is described in further detail:

[0036] Such as figure 1 As shown, the distributed file system proposed by the present invention includes a plurality of file nodes (the file nodes can be divided into different levels according to the actual situation and needs), and each file node provides the user with the entire distributed file system All file access operations;

[0037] Furthermore, the internal structure of each file node is consistent, mainly including the following parts:

[0038] Metadata server: responsible for managing metadata such as file names and data block storage locations of files stored in this file node; and providing operations such as metadata writing and query to file access clients of this node or other nodes; also used for Realize the remote scheduling of data blocks and the processing functions of aging data blocks;

[0039] File access client: used to provid...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed file system and a file processing method thereof. The distributed file system comprises at least two file nodes, each file node comprises a metadata server, a file access client, a file access server and storage medium, and each file node can access other file nodes. The corresponding file processing method comprises the following steps: storing different files to each file node in a scattering way; as for each file node, accessing metadata / valid data of a needed file inside the node by a user of the node through the file access client of the node; if the metadata / valid data of a needed file is not accessed inside the node, accessing the metadata / valid data of a needed file on other nodes through the file access client. The invention effectively solves the problem that a metadata server is easy to become a property bottleneck when a great number of users access hot data together and can furthest release the storage space of certain file nodes by file processing methods, such as data block dispatching, data block aging, and the like, thereby greatly enhancing the utility ratio.

Description

technical field [0001] The invention relates to the technical field of data storage, in particular to a distributed file system and a file processing method thereof. Background technique [0002] With the rapid development of the Internet and multimedia industry, various storage technologies and storage systems have also been developed rapidly. These storage systems provide convenient, fast and efficient storage and access services for massive Internet information and multimedia data information. [0003] The current storage system is mainly divided into two types, one is a commercial disk array, such as SAN (StorageArea Network, storage area network), NAS (Network Attached Storage, network attached storage), etc.; the other is to use ordinary or commercial disks, These disks are managed through a distributed file system. The stability, reliability, and access speed of commercial disk arrays can be guaranteed, but there are disadvantages such as high cost and poor customiz...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F17/30206G06F16/1834H04N21/23109H04N21/23116H04N21/4722
Inventor 彭杰张波夏舰波
Owner ZTE CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap