Data distribution method applied to deduplication storage system and related equipment
A storage system and data distribution technology, applied in the direction of input/output to the record carrier, etc., can solve the problems of reducing access efficiency, aggravating network congestion, input and output resource consumption, and retrieving files too many communication rounds, etc., to improve access efficiency, The effect of avoiding network congestion and input and output resource consumption and shortening the generation time
Pending Publication Date: 2022-07-12
NAT UNIV OF DEFENSE TECH
View PDF0 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
The duplication of data will inevitably lead to unnecessary storage space and network transmission, which will bring a huge burden to the storage system, so it is necessary to delete redundant data to save space
[0003] Based on the above situation, the distributed storage system in the prior art eliminates redundant data blocks through data deduplication technology, which reduces access efficiency, because there are fewer block copies to maintain, and the partition blocks of files may be on several independent servers Separation, therefore, retrieving files requires excessive communication rounds, which exacerbates network congestion and I / O resource consumption
Furthermore, current strategies for this problem, by employing rewriting techniques or supplementary data copies, inevitably lead to more space usage
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0032] In order to make the objectives, technical solutions and advantages of the present application more clearly understood, the present application will be further described in detail below with reference to specific embodiments and accompanying drawings.
[0033] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present application shall have the usual meanings understood by those with ordinary skills in the field to which the present application belongs. "First", "second" and similar words used in the embodiments of the present application do not indicate any order, quantity or importance, but are only used to distinguish different components. "Comprising" or "comprising" and similar words mean that the elements or things appearing before the word encompass the elements or things recited after the word and their equivalents, but do not exclude other elements or things. Words like "connected" or "conne...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a data distribution method applied to a deduplication storage system and related equipment. The method comprises the following steps: constructing a hypergraph model according to an initial storage file data set arriving at a duplicate removal storage system in advance; based on the hypergraph model and the updated storage file data continuously reaching the deduplication storage system, obtaining distribution information of the updated storage file data through a preset hypergraph divider; and distributing the updated storage file data to the server corresponding to the distribution information in the plurality of servers according to the distribution information. The generation time of the distribution method is shortened, and the access span information is effectively limited, so that the access efficiency is improved.
Description
technical field [0001] The present application relates to the technical field of data storage, and in particular, to a data allocation method and related equipment applied to a deduplication storage system. Background technique [0002] With the emergence of social networks, cloud video services, etc., the amount of data in the era of big data is growing at an unprecedented rate. At the same time, massive amounts of duplicate data are flooding into storage systems. The duplication of data will inevitably lead to unnecessary storage space and network transmission, which will bring a huge burden to the storage system. Therefore, redundant data needs to be deleted to save space. [0003] Based on the above situation, the distributed storage system in the prior art uses data deduplication technology to eliminate redundant data blocks, which reduces the access efficiency because fewer block copies are maintained, and file partitions may be on several independent servers Separat...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F3/06
CPCG06F3/0608G06F3/0629G06F3/0652G06F3/0647G06F3/064
Inventor 罗来龙郭得科程葛瑶任棒棒孙宇辰
Owner NAT UNIV OF DEFENSE TECH