Scheduling method and system for distributed file system

A distributed file and scheduling method technology, applied in special data processing applications, instruments, electrical digital data processing, etc., can solve the problem of high energy consumption of storage devices, high human and financial resource costs for independent authentication module development, and massive NameNodes. Small file storage access efficiency is low and other problems, to achieve the effect of lightening the burden, saving human and financial resources, and high access efficiency

Inactive Publication Date: 2017-07-07
周长英
View PDF6 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] To sum up, the problems existing in the existing technology are: the existing distributed file system has a large energy consumption of the storage device, the burden of the name node NameNode, the low efficiency of storing and accessing a large number of small files, and the independent authentication module in the distributed file system High cost of development human and financial resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Scheduling method and system for distributed file system
  • Scheduling method and system for distributed file system
  • Scheduling method and system for distributed file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] In order to make the object, technical solution and advantages of the present invention more clear, the present invention will be further described in detail below in conjunction with the examples. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0037] The application principle of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0038] Such as figure 1 As shown, the scheduling system of the distributed file system provided by the embodiment of the present invention includes: a group load information acquisition module 1, a scheduling policy determination module 2, a data storage module 3, a small file storage module 4, an authentication module 5, and a path analysis module 6 , Processor 7.

[0039] The cluster load information acquisition module 1 is configured to periodically acquire the cluster load inform...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of computer applications and discloses a scheduling method and system for a distributed file system. A data storage module is arranged, so that the storage capability of each client is fully utilized and the effect of reducing the energy consumption of a storage device can be achieved; a small file storage module is arranged, so that the purposes of reducing the burden of NameNode and improving the storage access efficiency of massive small files are achieved; an authentication module is arranged, so that unified permission management of multiple business domains in the distributed file system can be realized; a unified authentication module is arranged, so that the development of an independent authentication module in the distributed file system is reduced, and the manpower and financial resources are saved; the repeatability of data storage can be greatly reduced and the occupation of network resources can be reduced; and a path analysis module is arranged and a new LOOKUP operation module is implanted in a core space of a memory, so that the distributed file system can finish pathname lookup.

Description

technical field [0001] The invention belongs to the technical field of computer applications, and in particular relates to a scheduling method and system of a distributed file system. Background technique [0002] Distributed File System (Distributed File System) means that the physical storage resources managed by the file system are not necessarily directly connected to the local node, but are connected to the node through a computer network. The design of the distributed file system is based on the client / server model. A typical network may include multiple servers accessed by multiple users. In addition, the peer-to-peer feature allows some systems to perform the dual roles of client and server. [0003] To sum up, the problems existing in the existing technology are: the existing distributed file system has a large energy consumption of the storage device, the burden of the name node NameNode, the low efficiency of storing and accessing a large number of small files, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/148G06F16/182Y02D10/00
Inventor 周长英王久增程根源王振利陈继莹刘保
Owner 周长英
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap