Unlock instant, AI-driven research and patent intelligence for your innovation.

Data storage method in distributed system

A distributed system and data storage technology, applied in database indexing, electronic digital data processing, structured data retrieval, etc., can solve problems such as difficulty in data maintenance and increase the risk of data loss, so as to facilitate data maintenance and reduce the risk of data loss. Effect

Active Publication Date: 2017-05-31
GEOVIS CO LTD
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the prior art, when the redundant data is distributed on different machines, a random method is adopted, and different machines are not selected, resulting in that the machines with the same data distribution may be fault-prone machines, thus causing difficulties in data maintenance and Increased risk of data loss

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method in distributed system
  • Data storage method in distributed system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments, wherein the schematic embodiments and descriptions are only used to explain the present invention, but are not intended to limit the present invention.

[0026] See attached figure 1 , is a distributed system to which the present invention is applied, and the system includes multiple computing nodes.

[0027] See attached figure 2 , a data storage method in a distributed system, the method comprises the steps of:

[0028] (1) Calculate the m nodes i in the distributed system according to the storage capacity, operating load and failure frequency according to the following formula (a) to determine the storage risk value R of each node i :

[0029] R i = S i ×P i +1 / F i ×Q i +G i × T i (a);

[0030] where S i Indicates the storage capacity of node i, P i Indicates the weight corresponding to the storage capacity, F i Indicates the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a data storage method in a distributed system. The data storage method in the distributed system comprises the steps of determining a storage risk value of each node according to a storage volume, a running load and failure frequency, and grouping multiple nodes, wherein each group comprises a node with a high storage risk value and a node with a low storage risk value, so that an average storage risk value in each group is relatively balanced, the situation that the multiple nodes in which redundant data is distributed are all the nodes where failures frequently occur, and the redundant data is distributed into the groups with balanced risks, which facilitates data maintenance and reduces the risk of losing data.

Description

[0001] 【Technical field】 [0002] The invention belongs to the field of data storage, in particular to a data storage method in a distributed system environment. [0003] 【Background technique】 [0004] Under normal circumstances, the maximum throughput provided by a machine can only reach 200MBps. If the usual machine mirroring method is used, that is, the data on several machines is completely consistent, it will take more than 20 hours to repair 12TB of data. Considering Under normal service pressure, the repair time will reach dozens of hours. [0005] In the existing technology, a distributed storage method is proposed, which divides the data into multiple libraries and replicates several redundant copies. Different redundant distributions of the same library are stored in different locations on different machines, which improves the repair speed. However, in the prior art, when the redundant data is distributed on different machines, a random method is adopted, and diffe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/22G06F16/27
Inventor 刘斌吴方才楚涌泉
Owner GEOVIS CO LTD