Method and apparatus for obtaining file in distributed file system cluster

A distributed file and cluster technology, applied in the field of data processing, can solve the problems of low file reading efficiency, large bandwidth resource consumption, and complicated data flow.

Active Publication Date: 2018-01-09
BEIJING QIYI CENTURY SCI & TECH CO LTD
View PDF5 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Then the client forwards the file to the front-end request service (such as CDN) in other ways, which will complicate the data flow of the whole pr

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and apparatus for obtaining file in distributed file system cluster
  • Method and apparatus for obtaining file in distributed file system cluster

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] In order to make the above objects, features and advantages of the present invention more comprehensible, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0045] One of the core ideas of the embodiments of the present invention is that the present invention proposes a method for efficiently downloading video files by directly accessing the server of the distributed file system through http / ftp, without changing the original distributed file storage system On the basis of the architecture, a path mapping server and a software development kit SDK (Software Development Kit, software development kit) path mapping server are added to the client server of the distributed file system, so that the path mapping server can mount the file The logical path of the point is converted into the real file path of the file, thereby achieving fast and efficient access to video resources, improving effi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a method and apparatus for obtaining a file in a distributed file system cluster. The method comprises the following steps: obtaining path information of a downloaded file, sending the path information to a software development kit, and obtaining a unified cluster entrance network protocol IP, a unified cluster service port number and a logical file path corresponding to the path information through the software development kit; determining a distributed file system corresponding to a to-be-downloaded file in the distributed file system cluster by usingthe unified cluster entrance network protocol IP and the unified cluster service port number, sending path conversion request information to the distributed file system, and when the distributed filesystem receives the path conversion request information, generating a real file path by using a path mapping server according to the logical file path; and obtaining the to-be-downloaded file according to the real file path. By application of the method and apparatus provided by the embodiment of the invention, the network data transmission between a client and a server of the file system can beavoided, thereby simplifying the data flow, reducing the time consumption, reducing the network bandwidth cost and improving the production efficiency.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a method for acquiring files in a distributed file system cluster and a device for acquiring files in a distributed file system cluster. Background technique [0002] With the rapid development of the Internet, it is easier for people to obtain the Internet resources they need. However, video resources are the most intuitive and informative resources. Therefore, the demand for access to massive video resources arises as the times require. [0003] However, in the prior art, the client sends a download request to the client server through a CDN (Content Delivery Network, content distribution network), and then the client server reads data from the server of the distributed file system to the local, and finally sends the download request to the client server. The data is returned to the client by the CDN, which will consume a lot of bandwidth resources in the case of a huge...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08G06F17/30
Inventor 牛立国李杰辉
Owner BEIJING QIYI CENTURY SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap