Distributed file system, file access method and client

A technology of distributed files and distributed systems, applied in transmission systems, electrical components, instruments, etc., can solve problems such as limiting the number of GFS files, limiting concurrent access to files, etc. effect of numbers

Active Publication Date: 2018-06-15
TENCENT TECH (SHENZHEN) CO LTD +1
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, since GFS has only one Master Server to provide the query of file directory and file meta information, this will limit the concurrent access of files, and, due to the memory limitation of a single Master Server, it will also limit the number of files in GFS

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed file system, file access method and client
  • Distributed file system, file access method and client
  • Distributed file system, file access method and client

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0024] The distributed file system provided by the present invention has figure 1 The structure shown includes: a master server (Master Server), at least one meta information server (Meta Server), and at least one node server (NodeServer). Wherein, the number of Meta Servers and Node Servers can be set according to the scale of the cluster, which is not specifically limited in the present invention.

[0025] from figure 1 As can be seen from the shown distributed system, the distributed system provided by the present invention adopts a three-layer architecture, wherein the uppermost layer is a Master Server, the second upper layer is at least one Meta Server, and the lowermost layer is at least one NodeServer. Based on this, this The distributed...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The application provides a distributed file system, a file access method and a client. Wherein, the method includes: accessing the file directory stored by the master server Master Server, and obtaining the routing information of the meta information server Meta Server associated with the file to be accessed from the Master Server; utilizing the obtained routing information to access the Meta Server, and obtaining the routing information from the The meta information of the file to be accessed is obtained from the Meta Server, and the obtained meta information is used to access the file to be accessed from multiple node servers Node Server.

Description

technical field [0001] This application relates to data storage technology, in particular to a distributed file system, a file access method and a client. Background technique [0002] At present, the typical representative distributed file system in the industry is Google's distributed file system, referred to as GFS. The GFS mainly consists of a main server (Master Server) and many block servers (ChunkServer). Wherein, the Master Server is mainly responsible for storing the file directory and meta information of each file in the file directory. Here, the meta information mainly includes: the size of the file, the number of data blocks into which the file is divided, the Chunk Server where the data blocks into which the file is divided are located, etc.; the Chunk Server is mainly responsible for storing the data blocks into which the file is divided. Usually, a file is divided into multiple data blocks according to a certain size, and each data block is called a Chunk, a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08G06F17/30
CPCH04L67/1097G06F11/2094G06F16/182G06F16/134G06F16/183H04L67/01G06F11/1464H04L67/10
Inventor 伍海君朱会灿邓大付李锐邹永强董乘宇阙太富王磊杨绍鹏张书鑫赵大勇刘畅陈晓东张银锋
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products