Construction and conversion method of heterogeneous partial repetition codes based on hierarchical crossover design
A construction method and repetition code technology, applied in the computer field, can solve problems such as large disk I/O overhead, complex calculation, and long repair time, and achieve the effect of minimizing overhead and repair time
Active Publication Date: 2022-03-15
CHANGAN UNIV
View PDF2 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
The design concept of the regenerative code is to minimize the repair bandwidth. However, the repair process performs a large number of linear combinations in the finite field, and the calculation is complex, and the amount of data that needs to be read is usually much greater than the amount of data sent to the regenerative node. Therefore, the disk I / O High overhead and long repair time
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0042] This embodiment provides a method for constructing a heterogeneous partial repetition code based on hierarchical crossover design, including the following steps:
[0043] Step 1: Perform (F, M) MDS encoding on the original file containing M data blocks, where M=5 is taken, and the original file containing data block M=5 is stored in 9 nodes in the distributed storage system , the capacity of each node is {2,2,3,3,3,3,3,1,1}. Construct (7,5) MDS code in finite field GF(8), generate F coding block, take F=7 here, use M=[M 1 m 2 m 3 m 4 m 5 ] represents the original information data of the storage nodes in the distributed storage system, where M 1 , M 2 ,...,M 5 Indicates the information symbol; F=[F 1 f 2 f 3 f 4 f 5 f 6 f 7 ] represents the generated code word of the MDS code stored in the distributed storage node, and F=M G MDS , where the generator matrix G of the (7,5) MDS code MDS =[I|P] 5×7 , where I is a 5×5 identity matrix, and P is a 5×2-dimensio...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention belongs to the field of computers, and relates to a method for constructing heterogeneous partial repetition codes based on hierarchical crossover design, comprising the following steps: Step 1: Perform (F, M) MDS encoding on an original file to generate F encoding blocks; Step 2 : According to the layer capacity is t i the u i Layers are layered; Step 3: Cross-connect each coding sub-layer, so that each coding block in each coding block sub-layer and each coding block of all the following coding block sub-layers are arranged and combined one by one in sequence to construct a new layer; step 4: multiple regeneration layers satisfying the repetition degree ρ are selected once, and the second selection makes the number of identical coding blocks in any two layers of each regeneration layer not exceed 1, and the new multiple regeneration layers are respectively associated with the coding block The layers jointly constitute multiple sets of heterogeneous partial repetition codes, and the method can minimize disk I / O overhead and repair time at the same time. The invention also includes a conversion method of homogeneous partial repetition codes, which realizes the conversion between homogeneous partial repetition codes by changing the number of layers and / or changing layer capacity.
Description
technical field [0001] The invention belongs to the field of computers, and in particular relates to a heterogeneous partial repetition code construction method and conversion method based on hierarchical crossover design. Background technique [0002] At present, the popular trend of mass data storage is to store data distributedly on different nodes in the system, allowing users to access data anytime and anywhere. This data storage method has been widely used in practical systems. Among them, RS code has more advantages in data storage in terms of storage space, but in the process of repairing a single faulty node, the entire file must be restored, and the bandwidth overhead is too large. In 2007, Dimakis et al. showed that there is a certain balance between storage space and repair bandwidth, and the points on the balance curve can be realized by a class of codes, called regenerative codes. It is based on the concept of network coding, the repair of a faulty node recove...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/067
Inventor 王静张雪飞贺书磊王淑霞王甜甜
Owner CHANGAN UNIV