Unlock instant, AI-driven research and patent intelligence for your innovation.

Distributed storage system

A distributed storage and memory technology, applied in file systems, redundant operations in data error detection, instrumentation, etc. problems such as data element management methods, to achieve the effect of improved performance, fast speed, and high management performance

Pending Publication Date: 2021-02-26
JIANGSU DAWN INFORMATION TECH CO LTD
View PDF0 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The current distributed storage technology does not have an efficient storage system and a high-performance data element management method, resulting in low efficiency of uploading and downloading files by the client

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed storage system
  • Distributed storage system
  • Distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The technical solution of the present invention will be further described below in conjunction with the accompanying drawings.

[0033] The invention provides a distributed storage system, such as figure 1 As shown, there are five service components including master node, backup node, data node, client service and RPC service. The master node is responsible for metadata management of the file directory tree and data node service management; the backup node is responsible for reconstructing the file directory tree and storing it locally; the data node is responsible for file storage; the client service is responsible for providing client The operation tool supports the operation of the entire file directory tree and the upload and download of files; the RPC service encapsulates the master node and data node, master node and backup node, and the RPC interface definition between the master node and the client.

[0034] The master node is the core of the system, including ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed storage system. The distributed storage system comprises five service components which comprises a main node, a backup node, a data node, a client service and anRPC service, a metadata management component in a main node constructs double buffer areas in a memory for storing operation logs, and when one buffer area is full, the two buffer areas are exchanged;the backup node regularly pulls the operation log from the main node, reconstructs the file directory tree in the memory, and regularly performs check point operation; and when the client uploads thefile, the main node returns information of several nodes with minimum occupied capacities in all the data nodes, the client selects one node to upload the file, and other nodes copy information fromthe node for redundant backup. According to the invention, the metadata management performance can be improved, the balance of data capacity is ensured, the pressure of the main node is reduced, and high-performance uploading and downloading services are provided for files.

Description

technical field [0001] The invention relates to a file storage system, in particular to a highly available and high-performance distributed storage system. Background technique [0002] In the era of big data explosion, tens of millions of files are generated along with the use, such as commodity picture information in the e-commerce environment, personnel photo information in the personnel management system, and picture information of capturing illegal photos at each intersection Wait, in the face of the data explosion, the first problem that needs to be solved is how to store files effectively. When the file server stores tens of millions of files, a large number of records will be stored in the storage structure. Obviously, the traditional stand-alone storage The model has been far from meeting the requirements of reality, and distributed storage has become an inevitable requirement of modern information storage. The current distributed storage technology does not have a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/182G06F16/172G06F16/16G06F16/14G06F11/14
CPCG06F11/1435G06F11/1464G06F16/148G06F16/162G06F16/172G06F16/182G06F16/184
Inventor 徐云龙王海荣姚伯祥陈辉
Owner JIANGSU DAWN INFORMATION TECH CO LTD