Method and device for duplication removal of file
A file and file storage technology, applied in the storage field, can solve the problems of occupying storage space, waste of storage space, repeated storage of files, etc., and achieve the effect of reducing the waste of storage resources and avoiding repeated storage
Active Publication Date: 2017-05-10
UNITED INFORMATION TECH
View PDF9 Cites 6 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
If multiple users share a storage space, different users often store files with the same content, resulting in repeated storage of files, occupying unnecessary storage space, and resulting in waste of storage space
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0016] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be described in detail below in conjunction with the accompanying drawings and embodiments.
[0017] see figure 1 , figure 1 It is a flowchart of a file deduplication method according to an embodiment of the present invention. The method is applied to a storage device and mainly includes the following steps:
[0018] Step 101. Acquire a file to be stored, and generate an identification value of the file to be stored based on the file content of the file to be stored.
[0019] The files to be stored are files uploaded by users or files from other sources.
[0020] When performing file deduplication, if you directly compare the file content to determine whether it is a file with the same content, due to the large amount of data in the file content, the deduplication efficiency will be very low, so in this embodiment, the ...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a method and device for duplication removal of a file. The method and device can be applied in a storage device. The method comprises the steps of obtaining the file to be stored, and generating an identity value of the file to be stored based on file contents of the file to be stored; comparing all identity values of stored files in the storage device with the identity value of the file to be stored, generating a link which points at one stored file if the stored file has the same identity value with the file to be stored, and adopting the link as the file to be stored and storing the link to a target file path; storing the file to be stored to the target file path and storing the identity value of the file to be stored as an attribute of the file to be stored if the stored file does not share the same identity value with the file to be stored. According to the method and device for duplication removal of the file, repeated storing of the file can be avoided, and the waste of storage resources can be reduced.
Description
technical field [0001] The present invention relates to the technical field of storage, in particular to a method and device for deduplication of files. Background technique [0002] In storage devices, file data, especially some audio and video files, take up a lot of storage space. If multiple users share a storage space, it often happens that different users store files with the same content, resulting in repeated storage of files, occupying unnecessary storage space, and resulting in waste of storage space. Contents of the invention [0003] In view of this, the purpose of the present invention is to provide a file deduplication method and device, which can avoid repeated storage of files and reduce waste of storage resources. [0004] In order to achieve the above object, the present invention provides the following technical solutions: [0005] A file deduplication method applied to a storage device, the method comprising: [0006] Obtain the file to be stored, an...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F17/30G06F3/06
CPCG06F3/0608G06F3/0643G06F3/0671G06F16/13
Inventor 金振成
Owner UNITED INFORMATION TECH