File data accessing method, apparatus and system

A file data and access method technology, applied in the field of network storage, can solve the problems of slow file access, inability to share, increase network interaction and disk reading, etc., so as to improve access speed, improve reading efficiency, and reduce network traffic. Effect

CN101510219BActive Publication Date: 2011-09-14CHENGDU HUAWEI TECH
0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Publication Date
2011-09-14

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention provides a method, a device and a system for file data access, and the file data accessing method comprises the following steps: a file metadata request message is sent to a metadata server; file metadata returned by the metadata server is received; and according to the comparison result of the file metadata, a preset file size value and preset hotspot frequency, all the file data is obtained from a local cache of the client terminal or a high-speed memory of a data server. The file data accessing method, the device and the system realize multilevel caching of files with small hotspot, and can obtain all the file data from the local cache or the high-speed cache of the data server especially for the files with small hotspot, thus improving the reading efficiency of the fileswith small hotspot in network memory, and further raising the access speed of the files with small hotspot and reducing network flow.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to network storage technology, in particular to a file data access method, file metadata sending method, device and system. Background technique

[0002] With the rapid development of computer networks and information technology, the global information storage capacity has increased rapidly. At the same time, network storage technology has continued to develop, distributed storage has been widely used, the network scale has continued to expand, and there are more and more access nodes. In many applications, such as WEB 2.0, the amount of data is huge, but usually only a small part of the content is accessed frequently, and a large number of clients access a storage node, and the file reading efficiency is very low, resulting in uneven network load and increased access delay And other issues.

[0003] In the process of realizing the present invention, the inventors found that there are at least the following problems in the prior ...

Examples

Embodiment 1

[0025] like figure 1 As shown, it is a schematic flow chart of a method for accessing file data in an embodiment of the present invention, and the method includes:

[0026] Step 101, sending a metadata request message of a file to a metadata server.

[0027] Step 102, receiving the metadata of the file returned by the metadata server.

[0028] Preferably, the metadata of the file may include one or more of the size attribute value of the file, the single-client access frequency / multi-client access frequency of the file, the file name of the file, and all data cache address information of the file.

[0029]Step 103, according to the comparison result of the metadata of the file with the predetermined value of the file size and the predetermined hotspot frequency, all the data of the file is obtained from the local cache of the client or from the high-speed memory of the data server.

[0030] Preferably, if the attribute value of the file size is less than a predetermined size...

Embodiment 2

[0049] Such as Figure 4 As shown, it is a schematic structural diagram of a client in an embodiment of the present invention, and the client 40 includes:

[0050] A metadata request unit 401, configured to send a metadata request message of the file to the metadata server, and to receive the metadata of the file returned by the metadata server;

[0051] A data obtaining unit 402, configured to obtain all data of the file from the local cache of the client or from the high-speed memory of the data server according to the comparison result of the metadata of the file with the predetermined value of the size of the file and the predetermined frequency of hotspots .

[0052] Preferably, the metadata of the received file may include the size attribute value of the file, the single-client access frequency / multi-client access frequency of the file, the file name of the file and all data caches of the file One or more of address information, where:

[0053] The data acquisition un...