Unlock instant, AI-driven research and patent intelligence for your innovation.

Node scheduling method and device and computer-readable storage medium

A scheduling method and node technology, applied in the field of data processing, can solve problems such as reducing the memory of the MFS system, achieve the effects of reducing memory consumption, reducing the probability of data loss, and improving efficiency and speed

Inactive Publication Date: 2018-08-07
上海帝联网络科技有限公司
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The technical problem solved by the embodiment of the present invention is how to reduce the memory consumed by the MFS system during node scheduling

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Node scheduling method and device and computer-readable storage medium
  • Node scheduling method and device and computer-readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] At present, in the distributed file system, every time a file or directory is created, there will be a file node (fsnode) data structure in the memory of the main server. The fsnode is applicable to various file types, including directories.

[0036]When the main server is initialized, it needs to obtain all fsnode node information and fsedge node information from the metadata storage file (metadata.mfs). When the user needs to access a certain node, the scheduling management can be performed directly in the memory. When the master server exits normally, copy the data structure in memory to metadata.mfs.

[0037] However, the master server needs to get metadata from metadata.mfs when initializing. Store the data in the memory, and then schedule the metadata in the memory. The memory consumption of the MFS system is proportional to the number of stored files. When the number of files stored in the system is large, the memory consumption is too large.

[0038] In the em...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A node scheduling method and device and a computer-readable storage medium are provided. The node scheduling method includes: when a node scheduling command is received, acquiring target node identifier information from the node scheduling command; acquiring value of a target node corresponding to the target node identifier information from a preset database; determining node type of the target node according to the value of the target node; applying for a corresponding memory for the target node according to the node type of the target node, acquiring node information of the target node fromthe database, wherein the node information includes node data structure; when a usage completion command of the target node is received, releasing the memory that the target node uses. The node scheduling method and device and the computer-readable storage medium have the advantage that less memory can be consumed by an MFS (Moose file system) during node scheduling.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of data processing, and in particular, to a node scheduling method and device, and a computer-readable storage medium. Background technique [0002] MooseFS is a highly fault-tolerant distributed file system, hereinafter referred to as MFS. MFS can distribute and store resources in several different physical media, and only provide users with one access interface. [0003] The architecture of MFS mainly includes: main server (master server), block server (chunkservers), backup server (metalogger servers) and client. The master server is used to manage the entire file system and store the metadata of each file (including file size, attributes, and storage location, as well as some irregular files, such as directories, sockets, and pipes. and equipment). A block server is a server used to store files, is scheduled by the master server, and provides data transmission for clients. Th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50G06F17/30
CPCG06F9/5016G06F16/182
Inventor 严源源
Owner 上海帝联网络科技有限公司