File traversal method, apparatus and system

A traversal and file technology, applied in the computer field, can solve problems such as heavy storage node load and decline in storage cluster service level, and achieve the effect of reducing load pressure and improving performance

Active Publication Date: 2015-11-04
BEIJING QIYI CENTURY SCI & TECH CO LTD
View PDF7 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In this way, a large number of IO requests will be triggered, which will cause a large load on each storage node and reduce the service level of the entire storage cluster.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File traversal method, apparatus and system
  • File traversal method, apparatus and system
  • File traversal method, apparatus and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0065] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described The embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0066] Firstly, the application scenarios of the embodiments of the present invention will be described.

[0067] An embodiment of the present invention provides a file traversal method, which can be applied to a traversal server. In practical applications, the following services can be run in the traver...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

An embodiment of the invention discloses a file traversal method, apparatus and system. The file traversal method is applied to a traversal server; the traversal server generates an initial traversal task according to a received traversal request for a target storage cluster, and receives a sub-task set obtained after splitting the initial traversal task by a first storage node; each storage node in the target storage cluster generates a sub-task request; and storage nodes corresponding to sub-tasks in the sub-task set finish file traversal operations respectively and receive traversal data returned by the storage nodes to generate a traversal result. By applying the technical scheme provided by the embodiment of the invention, the traversal server performs generation of the initial traversal task and distribution of the sub-tasks in a file traversal process; each storage node executes the corresponding sub-task in the local; and the storage nodes are not interacted, so that the file traversal performance is improved and the load pressure of the storage cluster is reduced.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a file traversal method, device and system. Background technique [0002] A distributed file system consists of multiple storage clusters, and each storage cluster has multiple storage nodes. In order to carry the storage of massive files, the distributed file system generally adopts a decentralized design, which not only facilitates horizontal expansion, but also avoids single-point failures that cause the entire system to fail to operate normally, and maintains high availability of the distributed file system. For ease of use, a distributed file system generally exposes a Portable Operating System Interface (POSIX), which can be mounted and used on a client computer. [0003] In a decentralized distributed file system, no node saves the full amount of metadata. If file traversal operations are required during data migration or file archiving, it is impossible to query all th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/148G06F16/182G06F16/284
Inventor 徐寅俊
Owner BEIJING QIYI CENTURY SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap