Construction and conversion of heterogeneous partial repetition codes based on hierarchical crossover design
A technology of construction method and conversion method, which is applied in the computer field, can solve the problems of large disk I/O overhead, complex operation, long repair time, etc., and achieve the effect of minimizing the cost and repair time
Active Publication Date: 2019-03-26
CHANGAN UNIV
View PDF2 Cites 3 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
The design concept of the regenerative code is to minimize the repair bandwidth. However, the repair process performs a large number of linear combinations in the finite field, and the calculation is complex, and the amount of data that needs to be read is usually much greater than the amount of data sent to the regenerative node. Therefore, the disk I / O High overhead and long repair time
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0042] This embodiment provides a method for constructing a heterogeneous partial repetition code based on hierarchical crossover design, including the following steps:
[0043] Step 1: Perform (F, M) MDS encoding on the original file containing M data blocks, where M=5 is taken, and the original file containing data block M=5 is stored in 9 nodes in the distributed storage system , the capacity of each node is {2,2,3,3,3,3,3,1,1}. Construct (7,5) MDS code in finite field GF(8), generate F coding block, take F=7 here, use M=[M 1 m 2 m 3 m 4 m 5 ] represents the original information data of the storage nodes in the distributed storage system, where M 1 , M 2 ,...,M 5 Indicates the information symbol; F=[F 1 f 2 f 3 f 4 f 5 f 6 f 7 ] represents the generated code word of the MDS code stored in the distributed storage node, and F=M G MDS , where the generator matrix G of the (7,5) MDS code MDS =[I|P] 5×7 , where I is a 5×5 identity matrix, and P is a 5×2-dimensio...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention belongs to the computer field and relates to a method for constructing heterogeneous partial repetition codes based on hierarchical crossover design. The method comprises the following steps: step 1, carrying out (F, M) MDS encoding on an original file to generate F encoding blocks; Step 2, layering according to the ui layer with the layer capacity of ti; 3, crossly connecting each coding sub-layer so that each code block in each coding sub-layer and each coding block of all code sub-layers below are sequentially arranged and combined to construct a new layer; 4, selecting a plurality of regenerated layer satisfying that repetition degree rho at one time, making the number of identical code blocks of any two layers of each regenerated layer not exceed 1 at the second time, and forming a plurality of groups of heterogeneous partial repetition codes with the new plurality of regenerated layers and the code block layers respectively, so that the method can simultaneously minimize disk I / O overhead and repair time. The invention also includes a conversion method of isomeric partial repetition codes, which realizes the conversion between isomeric partial repetition codes by changing the number of layers and / or changing the capacity of layers.
Description
technical field [0001] The invention belongs to the field of computers, and in particular relates to a heterogeneous partial repetition code construction method and conversion method based on hierarchical crossover design. Background technique [0002] At present, the popular trend of mass data storage is to store data distributedly on different nodes in the system, allowing users to access data anytime and anywhere. This data storage method has been widely used in practical systems. Among them, RS code has more advantages in data storage in terms of storage space, but in the process of repairing a single faulty node, the entire file must be restored, and the bandwidth overhead is too large. In 2007, Dimakis et al. showed that there is a certain balance between storage space and repair bandwidth, and the points on the balance curve can be realized by a class of codes, called regenerative codes. It is based on the concept of network coding, the repair of a faulty node recove...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/067
Inventor 王静张雪飞贺书磊王淑霞王甜甜
Owner CHANGAN UNIV