Unlock instant, AI-driven research and patent intelligence for your innovation.

A distributed system-based file reading method and device

A distributed system and file reading technology, applied in the field of communication, can solve the problems of increased pressure on the storage server to read data, low system performance, and client response delay.

Active Publication Date: 2019-01-11
HUAWEI TECH CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The limited cache capacity causes the data blocks cached by the file interface server to be quickly deleted. Every time the client sends a file read request, the storage server needs to read at least N data blocks and their version numbers through the storage server, and the storage server reads data under pressure. increase, resulting in client response delays and lower system performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A distributed system-based file reading method and device
  • A distributed system-based file reading method and device
  • A distributed system-based file reading method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] The technical solutions in the embodiments of the present invention will be clearly described below in conjunction with the drawings in the embodiments of the present invention.

[0042] See figure 1 , figure 1 It is a schematic diagram of the framework of a distributed system provided in an embodiment of the present invention. As shown in the figure, the distributed system in the embodiment of the present invention may at least include a client, a file interface server, a storage server, and a lock server. Among them, the client can establish a communication connection with the file interface server through the network, and the file interface server establishes a communication connection with the lock server and the storage server respectively. At least two storage servers can form a storage server cluster through the network.

[0043] The client is used to send a file read request to the file interface server, and the file read request carries the offset address and the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A distributed system-based file reading method and device. The method comprises: determining, according to an offset address and a reading data quantity carried in a file reading request sent by a client side, at least one target data block the client side needs to read and a target data stripe to which the target data block belongs; when the at least one target data block is partial data in the target data stripe, sending to a lock server a data stripe version number acquisition request in respect of the target data stripe; sending a data block acquisition request to each storage server for storing the target data block; and when a data stripe version number fed back by the lock server is identical to a data block version number corresponding to the target data block fed back by each storage server, sending the target data block to the client side. By adopting the method, when a data block a client side needs to read is partial data in a data stripe, the whole data stripe is prevented from being read in a file system, and system performance is effectively increased.

Description

Technical field [0001] The present invention relates to the field of communication technology, in particular to a file reading method and device based on a distributed system. Background technique [0002] The distributed system may include a file interface server, a storage server, and a lock server, which are used to implement file interface services, storage services, and lock services. The file interface server is used to process network file protocols, complete metadata processing, and file read and write operations; storage The server is used to complete the storage of files and metadata; the lock server is used to complete the management of distributed locks. In a distributed system, in order to improve the reliability of file data and the utilization of storage space, the storage of file data adopts the N+M protection method, in which the file data is divided into at least N data blocks and passed EC (Erasure Code, data verification erasure code) algorithm to obtain M ve...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/14G06F16/182
CPCG06F16/00
Inventor 谢晓芹
Owner HUAWEI TECH CO LTD