Unlock instant, AI-driven research and patent intelligence for your innovation.

Heterogeneous node streaming data distributed storage method

A distributed storage and streaming data technology, applied in the direction of selective content distribution, image communication, transmission system, etc., to achieve the effect of stable data input, high utilization rate, and reduced power consumption

Active Publication Date: 2020-11-20
BEIJING ICHINAE SCI & TECH CO LTD
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a heterogeneous node streaming data distributed storage method, thereby solving the aforementioned problems in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Heterogeneous node streaming data distributed storage method
  • Heterogeneous node streaming data distributed storage method
  • Heterogeneous node streaming data distributed storage method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0052] In this embodiment, the data blocks in the streaming data source are k=3, m=1, n=1; the data blocks in the streaming data source are allocated to satisfy the storage node P[x] ≥ The number of storage nodes required by R[y] is in storage node clusters with 10, 4 and 2 storage nodes.

[0053] The streaming data source is allocated according to the four allocation algorithm principles, and the initial allocation result between the streaming data source and the storage node is as follows: image 3 shown;

[0054] On the basis of the initial allocation, when a new storage node is added, the allocation result is as follows Figure 4 shown;

[0055] On the basis of the initial allocation, when a new storage node is added, the allocation result is as follows Figure 5 shown.

[0056] By adopting the above-mentioned technical scheme disclosed by the present invention, the following beneficial effects are obtained:

[0057] The invention discloses a distributed storage metho...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

According to the heterogeneous node streaming data distributed storage method, storage system resources and data traffic are matched by utilizing the characteristics of streaming data, so that the heterogeneous storage system resources are better utilized; in a streaming storage application scene, the storage capacity is marked by P [x], the storage capacity is preferentially used with high storage capacity, data distribution can be performed as long as the remaining storage capacity exists in the whole system, and equalization does not need to be performed during system capacity expansion. According to the invention, different distribution modes are selected according to different scenes, so that higher storage security of data, or high throughput of the system, or high utilization rate of system resources can be ensured, or the number of running systems can be reduced, thereby reducing power consumption.

Description

technical field [0001] The invention relates to the field of data storage, in particular to a method for distributed storage of streaming data of heterogeneous nodes. Background technique [0002] When the distributed storage scheme in the prior art is used for the storage of lost data such as video storage, it is necessary to generate video files first, and then store the hash of the formed video files in each storage disk; the data generation in streaming storage The rate is relatively stable and regular; the control method of superimposing streaming storage on the basis of the above-mentioned file storage can achieve equalization, but it cannot make full use of the characteristics of streaming storage, and it is necessary to frequently schedule the allocation of data storage, balance Degree priority, for systems with different storage capabilities of storage nodes, the matching of data and storage capabilities cannot be achieved; when the system expands, the data stored i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N21/218H04L29/08
CPCH04N21/2181H04L67/1097
Inventor 吴小岭瞿洪桂高亚召范园利齐翔许文华
Owner BEIJING ICHINAE SCI & TECH CO LTD