Host-based storage deduplication processing method and device
A processing method and host technology, applied in the computer field, can solve problems such as low throughput rate, and achieve the effects of increasing throughput rate, improving fingerprint search efficiency, and improving storage deduplication efficiency
Active Publication Date: 2020-05-08
INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF3 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Many studies have shown that if the data slice is smaller, the deduplication rate will be greater, but it will lead to low throughput; conversely, the larger the data slice, the deduplication rate will decrease, but the throughput rate will increase.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0039] Embodiments of the present invention are described below. It is to be understood, however, that the disclosed embodiments are merely examples and that other embodiments may take various alternative forms. The figures are not necessarily to scale; some features may be exaggerated or minimized to show details of particular components. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for teaching one skilled in the art to variously employ the present invention. As will be understood by persons of ordinary skill in the art, various features shown and described with reference to any one figure can be combined with features shown in one or more other figures to create embodiments not explicitly shown or described . Combinations of features shown provide representative embodiments for typical applications. However, various combinations and modifications of the features consiste...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a host-based storage deduplication processing method, which comprises the following steps of: adding a host label to a data block fingerprint in a hard disk, taking the fingerprint of the same host as a set, and calculating a fingerprint popularity degree and a host set popularity degree in each host set; loading the fingerprint in the host with the highest host set popularity into a memory and / or sorting all the fingerprint popularity from high to low so as to load a plurality of fingerprints with the highest sorting into the memory; in response to writing data into thehard disk, calculating a fingerprint of the data and searching the fingerprint from the memory so as to carry out deduplication processing on the searched fingerprint; and in response to the fact that the fingerprint is not found in the memory, searching the fingerprint from the hard disk, and updating the fingerprint popularity and the host set popularity written into the host. Compared with searching the fingerprint data from the hard disk, the fingerprint searching efficiency is improved, the throughput rate is further improved, and the storage deduplication efficiency is improved.
Description
technical field [0001] The present invention relates to the computer field, and more specifically, to a host-based storage deduplication processing method and device. Background technique [0002] Data deduplication (data deduplication processing) is a major technology for data reduction in enterprise storage. Deduplication is to save only one copy of the same data on storage, and reserve an address for other duplicate data blocks to refer to this unique storage block. The fingerprint is calculated by dividing the data into blocks according to the specified size, and judging whether it is the same data through the fingerprint. In this way, a large amount of redundant data can save a lot of storage space through deduplication processing, saving storage space for enterprises and reducing storage cost investment. [0003] Measuring the effect of data deduplication can be summarized as two indicators: deduplication rate and throughput rate. The data deduplication rate is high, ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0641G06F3/0613G06F3/0674
Inventor 陈东河
Owner INSPUR SUZHOU INTELLIGENT TECH CO LTD