Method and device for accessing files and distributed storage system

A distributed storage and file technology, applied in the field of data transmission, can solve problems that cannot meet the needs of large-scale storage applications, and achieve the effect of reducing operating costs

Active Publication Date: 2015-06-24
TENCENT TECH (SHENZHEN) CO LTD +1
View PDF7 Cites 68 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Traditional network storage systems use centralized storage servers to store all data. Storage servers become the bottleneck of system performance and the focus of reliability and security, which cannot meet the needs of large-scale storage applications.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for accessing files and distributed storage system
  • Method and device for accessing files and distributed storage system
  • Method and device for accessing files and distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0052] figure 1 A schematic diagram of the architecture of the distributed storage system provided in the first embodiment. Such as figure 1 As shown, the distributed storage system 100 is deployed in two or more ( figure 1Only two are shown in ) data centers 10,20. The data center 10 includes a metadata server cluster 101 , a first data server cluster 102 , and one or more servers 103 . The data center 20 includes a second data server cluster 104 and one or more servers 105 . Wherein, the server 103 and the server 105 jointly constitute a third data server cluster 106 . The distributed storage system 100 is used to store (upload), download, update, or delete files according to the request of the portal server 200 .

[0053] Multiple servers in the metadata server cluster 101 constitute a distributed storage system for storing metadata of files. The above-mentioned distributed storage system may be, for example, the above-mentioned Key-Value storage system. The aforemen...

no. 2 example

[0092] The second embodiment provides a method for accessing files in a distributed storage system, which can be used for figure 1 Ingress server 200 is shown. refer to Figure 8 , the method of this embodiment includes the following steps:

[0093] Step S201, receiving the file uploaded by the client.

[0094] The client here refers to for example figure 1 The user terminal 300 is shown. The user terminal 300 can log in to the web application provided by the portal server 200 through a running application program (such as a browser), and upload files to the portal server 200 through the web application. Correspondingly, the portal server 200 receives the file uploaded by the user terminal 300 .

[0095] Step S202, sending a file index acquisition request to the metadata server cluster to acquire the metadata index returned by the metadata server cluster.

[0096] The file index acquisition request may include some metadata of the file, such as file length, file name, fi...

no. 3 example

[0104] The third embodiment provides a method for accessing files in a distributed storage system, which can be used for figure 1 Ingress server 200 is shown. refer to Figure 9 , the method of this embodiment includes the following steps:

[0105] Step S301, receiving a file download request from the client.

[0106] The user terminal 300 can log in to the web application provided by the portal server 200 through a running application program (such as a browser), and send a file download request to the portal server 200 through the web application. The file download request is associated with one or more target files.

[0107] Step S302, sending a metadata query request to the metadata server cluster to acquire the metadata of the at least one target file returned by the metadata server cluster.

[0108] The entry server 200 sends a metadata query request to the metadata server cluster 101 to acquire metadata returned by the metadata server cluster 101 . The metadata que...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method and device for accessing files and a distributed storage system. The method includes: receiving a file uploaded by a client; sending a file index obtaining request to a metadata server cluster and obtaining a metadata index returned by the metadata server cluster; sending the file or the slicing of the file to a selected data server cluster for storage; and sending the storage index of the file or the slicing of the file in the selected data server cluster, the identifier of the selected data server cluster and the metadata index to the metadata server cluster for associate storage. According to the method and device for accessing the files and the distributed storage system, since the data is stored in the data server clusters of different data centers, the operating cost of the distributed storage system of the data center can be reduced.

Description

technical field [0001] The invention relates to data transmission technology, in particular to a method, device and distributed storage system for accessing files. Background technique [0002] A distributed storage system stores data dispersedly on multiple independent devices. Traditional network storage systems use centralized storage servers to store all data. Storage servers become the bottleneck of system performance and the focus of reliability and security, which cannot meet the needs of large-scale storage applications. The distributed network storage system adopts a scalable system structure, uses multiple storage servers to share the storage load, and uses the location server to locate and store information. It not only improves the reliability, availability and access efficiency of the system, but also is easy to expand. [0003] However, in existing distributed storage systems, in order to ensure storage security, at least one copy of each file needs to be save...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06H04L29/06H04L29/08
Inventor 王炎娄继冰李博
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap