A method and device for deduplication of data

A technology of deduplication and data block, applied in the computer field, can solve the problem of high hardware cost, achieve the effect of improving efficiency, speeding up and eliminating system bottlenecks

Active Publication Date: 2018-06-19
HUAWEI TECH CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although improving the hardware performance of the deduplication server can eliminate the bottleneck of the system without delaying the transmission of image files by the client, the high cost of the hardware has discouraged many developers.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and device for deduplication of data
  • A method and device for deduplication of data
  • A method and device for deduplication of data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0060] By adopting the present invention, by establishing a fingerprint database and dividing the fingerprint database according to the types of operating systems, the efficiency of comparing fingerprints can be improved and the speed of repeated data deletion can be accelerated.

[0061] see figure 1 , figure 1 It is a schematic flowchart of a method for deduplicating data according to an embodiment of the present invention. The embodiment of the pr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a method and device for deleting repeating data. The method comprises the step of establishing a fingerprint library according to fingerprints corresponding to data blocks of an originally received first mirror image document, wherein the first mirror image document is an originally received mirror image document of a virtual machine; the step of dividing the fingerprint library into at least one fingerprint module, wherein each fingerprint module corresponds to one operation system type; the step of receiving a second mirror image document, and calling the fingerprint module corresponding to the operation system type of the second mirror image document; the step of obtaining the fingerprints corresponding to the data blocks of the second mirror image document; the step of comparing the obtained fingerprints with the fingerprints of the called fingerprint module one by one and deleting the data blocks corresponding to the fingerprints repeated with the fingerprints in the fingerprint module. By means of the method and device, the fingerprint library is established and divided according to the operation system types, efficiency of fingerprint comparison is improved, and the speed of deleting the repeating data is improved.

Description

technical field [0001] The invention relates to the field of computers, in particular to a method and device for deduplicating data. Background technique [0002] A virtual machine refers to a complete computer system with complete hardware system functions simulated by software and running in a completely isolated environment. One physical computer simulates another or more virtual computers, so it can be used on the same computer. Multiple systems running on a physical computer. At present, many users use virtual machines to improve computer operation efficiency, which has gradually become popular. However, the data of the image file of the virtual machine has a high repetition rate, so the repeated image file needs to be deleted to reduce the storage capacity used in the storage system. Generally, the deduplication server receives the image file sent by the client, and then performs data deduplication on the received image file. If the transmission speed of the client ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & AuthorityPatents(China)
IPC IPC(8): G06F17/30
CPCG06F16/1752
Inventor褚艳旭裘杰江云飞
OwnerHUAWEI TECH CO LTD