An adaptive distributed data storage method and system based on fountain code
A technology of distributed data and fountain codes, applied in the direction of digital transmission system, transmission modification based on link quality, error detection of redundant data in calculation, etc., can solve the problems of fixed redundancy rate, inconvenience, and no Adaptability and other issues to achieve the effect of saving media space, reducing occupied space, and improving data recovery capabilities
Active Publication Date: 2022-07-26
TOYOU FEIJI ELECTRONICS
View PDF6 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] However, the existing data storage technology based on fountain codes has a technical disadvantage that the redundancy rate is fixed, and the redundancy rate is determined before the source file is transformed into fountain codes, and different redundancy cannot be used according to the harsh conditions of the application environment. rate, not adaptive
[0006] It can be seen that the above-mentioned existing data storage method based on the fountain code still has inconvenience and defects, and needs to be further improved urgently.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0030] Refer to the attached figure 1 As shown, the adaptive distributed data storage method based on fountain codes in this embodiment includes the following steps:
[0031] (1) Divide the source symbol sequence of the original data into K groups.
[0032] (2) Feedback the system state value V of the data storage system through the I / O controller 0 , and then the coding controller calculates the redundancy rate α required by the fountain code coding, where α=f(V 0 ).
[0033] The system state value V 0 It is determined according to the RAID level of the disk array of the data storage system. The existing RAID levels of the disk array include: RAID 0, RAID1, RAID3, RAID5, RAID6, RAID10 / 01, RAID50, and the redundancy rate α=f(V 0 ) using the step function related to the RAID level of the disk array:
[0034]
[0035] (3) According to the obtained redundancy rate α, the encoding controller performs a fountain code operation on the K groups of source symbol sequences divi...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses an adaptive distributed data storage method based on fountain codes, comprising: dividing the source symbol sequence of original data into K groups; feeding back a system state value V through an I / O controller 0 , the redundancy rate α is calculated by the coding controller, and the fountain code operation is performed on the K groups of source symbol sequences according to the redundancy rate α to generate (1+a) data packets, and then each data packet is encoded and stored in a distributed manner at most A new system state value V is generated according to the change of the system application scene i , get the redundancy rate α again, repeat the fountain code operation and data packet encoding until all the data are stored. An adaptive distributed data storage system based on fountain codes is also disclosed. According to different application scenarios and environmental conditions in which the system is located, the present invention uses the feedback channel to feed back the system state value, selects different redundancy rates, reduces the space occupied by data backup in a timely manner, or improves the data recovery capability of the system, and has strong adaptive capability.
Description
technical field [0001] The invention relates to the field of Internet data storage, in particular to an adaptive distributed data storage method and system based on fountain codes. Background technique [0002] With the rapid development of mobile Internet technology and the explosive growth of business data, the business of enterprises is increasingly dependent on accurate data information. Therefore, the status of storage systems in enterprise information systems has become increasingly prominent. At present, the data storage methods of storage systems are mainly divided into: centralized and distributed. Regardless of whether centralized storage or distributed storage is used, the system must meet security, reliability and data integrity. In order to ensure the reliability of key data and ensure that key data is not lost or damaged, the storage system will adopt corresponding data backup technology and data recovery technology according to the application requirements of...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): H04L1/00H04L67/1095H04L67/1097G06F11/14G06F16/27
CPCH04L1/0056H04L1/0016H04L67/1095H04L67/1097G06F11/1448G06F16/27
Inventor 杨宏兵周天睿袁鹏飞宣旭迎杨恒周泽湘罗华仇悦文中领王爽
Owner TOYOU FEIJI ELECTRONICS