Adaptive distributed data storage method and system based on fountain codes
A technology of distributed data and storage system, applied in the field of adaptive distributed data storage based on fountain code, can solve the problems of fixed redundancy rate, no self-adaptation, and inability to vary redundancy rate, so as to reduce the occupied space , The effect of improving data recovery ability and saving media space
Active Publication Date: 2020-06-12
TOYOU FEIJI ELECTRONICS
View PDF6 Cites 2 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] However, the existing data storage technology based on fountain codes has a technical disadvantage that the redundancy rate is fixed, and the redundancy rate is determined before the source file is transformed into fountain codes, and different redundancy cannot be used according to the harsh conditions of the application environment. rate, not adaptive
[0006] It can be seen that the above-mentioned existing data storage method based on the fountain code still has inconvenience and defects, and needs to be further improved urgently.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0030] Refer to attached figure 1 As shown, the adaptive distributed data storage method based on the fountain code in this embodiment includes the following steps:
[0031] (1) Divide the source symbol sequences of the original data into K groups.
[0032] (2) Feedback the system state value V of the data storage system through the I / O controller 0 , and then the encoding controller calculates the redundancy rate α required for fountain code encoding, where α=f(V 0 ).
[0033] The system state value V 0 It is determined according to the disk array RAID level of the data storage system, and the existing disk array RAID levels include: RAID 0, RAID1, RAID3, RAID5, RAID6, RAID10 / 01, RAID50, the redundancy rate α=f(V 0 ) adopts the step function related to the RAID level of the disk array:
[0034]
[0035] (3) According to the obtained redundancy rate α, the encoding controller performs fountain code operation on the K groups of source symbol sequences divided into the s...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a fountain code-based adaptive distributed data storage method. The method comprises the following steps: dividing an information source symbol sequence of original data into Kgroups; feeding back a system state value V0 through an I / O controller, calculating a redundancy rate alpha through an encoding controller, performing fountain code operation on K sets of informationsource symbol sequences according to the redundancy rate alpha, generating (1 + a) data packets, and then encoding and storing each data packet in multiple media in a scattered mode; generating a newsystem state value Vi according to the change of a system application scene, obtaining a redundancy rate alpha again, and repeating fountain code operation and data packet coding until all data is completely stored. The invention further discloses an adaptive distributed data storage system based on the fountain codes. According to different application scenes and environment conditions of the system, the feedback channel is used for feeding back the system state value, different redundancy rates are selected, the data backup occupied space is reduced in time, or the data recovery capacity ofthe system is improved, and the self-adaptive capacity is high.
Description
technical field [0001] The invention relates to the field of Internet data storage, in particular to an adaptive distributed data storage method and system based on fountain codes. Background technique [0002] With the rapid development of mobile Internet technology and the explosive growth of business data, the business of enterprises is increasingly dependent on accurate data information. Therefore, the status of storage systems in enterprise information systems has become increasingly prominent. At present, the data storage methods of the storage system are mainly divided into: centralized and distributed. Regardless of whether centralized storage or distributed storage is used, the system must meet security, reliability and data integrity. In order to ensure the reliability of key data and ensure that key data is not lost or damaged, the storage system will adopt corresponding data backup technology and data recovery technology according to the application requirements...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): H04L1/00H04L29/08G06F11/14G06F16/27
CPCH04L1/0056H04L1/0016H04L67/1095H04L67/1097G06F11/1448G06F16/27
Inventor 杨宏兵周天睿袁鹏飞宣旭迎杨恒周泽湘罗华仇悦文中领王爽
Owner TOYOU FEIJI ELECTRONICS