Modeling Method for Storage Resource Scheduling Model of Distributed Streaming Data Storage System
A storage resource and storage system technology, applied in the field of stream data storage, can solve the problems of high power consumption, a large number of fragments, and large equipment loss in the distributed stream data storage system, so as to maximize the write bandwidth, reduce fragmentation, and reduce power consumption. costly effect
Active Publication Date: 2019-01-08
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF4 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] The present invention aims to solve the problems of high power consumption of the distributed stream data storage system, large equipment loss, and a large number of fragments generated after the stream data is deleted
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0022] An embodiment of the present invention provides a modeling method for a storage resource scheduling model of a distributed stream data storage system, where the stream data can be sensor network data, aerospace monitoring data, weather monitoring data, financial service data, or figure 1 Shown video stream data, etc., the distributed stream data storage system and figure 1 The shown distributed video stream data storage system is similar, including a meta server and X data servers, and each data server includes Y disks. Wherein, X and Y are integers not less than 2, and their specific values are determined according to the actual amount of stream data to be stored: the greater the amount of stream data, the greater the values of X and Y. The modeling method of the storage resource scheduling model of the distributed stream data storage system includes:
[0023] Step S11: striping all disks;
[0024] Step S12: Collect N stripes in the same data server into a stripe...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
A modeling method for a storage resource scheduling model of a distributed streaming data storage system, the distributed streaming data storage system includes a meta server and X data servers, each data server includes Y disks, and X and Y are not less than Integer of 2. The modeling method includes: striping all disks; aggregating N stripes in the same data server into a stripe bundle, where any two stripes in the stripe bundle are not on the same disk, and N is A positive integer not greater than M / D; all stripes are bundled into a storage resource stripe, and any two adjacent stripe bundles in the storage resource stripe are not in the same data server; writes to be executed in the same stripe The tasks are grouped into a task bundle, and all task bundles form a task total window, so that the task total window can be scrolled in the storage resource band. The modeling method provided by the invention can reduce the power consumption of the distributed flow data storage system, reduce equipment loss, and reduce generated fragments.
Description
technical field [0001] The invention relates to the technical field of stream data storage, in particular to a modeling method for a storage resource scheduling model of a distributed stream data storage system. Background technique [0002] A distributed storage system is a storage system that stores data dispersedly on multiple independent devices. Traditional network storage systems use centralized storage servers to store all data. Storage servers become the bottleneck of system performance and the focus of reliability and security, which cannot meet the needs of large-scale storage applications. The distributed network storage system adopts a scalable system structure, uses multiple storage servers to share the storage load, and uses location servers to locate and store information, which not only improves the reliability, availability and access efficiency of the system, but also facilitates expansion. [0003] figure 1 It is a schematic structural diagram of a typic...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08
CPCH04L67/1097H04L67/60Y02D30/50
Inventor 段翰聪闵革勇张建陈楚材郑松张博彭玉炳周波
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA