Compression packet uploading and duplication-removing system and method

A compressed package, encrypted compression technology, applied in transmission systems, electrical components, etc., can solve the problems of wasting storage space, affecting upload speed, etc., and achieve the effect of multiple storage spaces

CN103873438AInactive Publication Date: 2014-06-18HONG FU JIN PRECISION IND (SHENZHEN) CO LTD +1
6 Cites 22 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Publication Date
2014-06-18
Estimated Expiration
Not applicable · inactive patent

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

Provided is a compression packet uploading and duplication-removing method which comprises that: a compression packet uploaded by a user is divided into multiple data blocks; Hash values of all the data blocks are calculated; information of whether the compression packet is the encrypted compression packet, the Hash value of the compression packet, the Hash values of all the data blocks and sequences of the data blocks are stored in one Hash table and then uploaded to a Hash database; when the Hash values in the Hash database are identical with the Hash values of the stored data blocks in a storage server, the data blocks corresponding to the Hash values in the Hash database are confirmed to be duplicated data blocks; corresponding client terminals are notified not to upload the data blocks and corresponding data block pointers of the duplicated data blocks are returned to users, and each data block is corresponding to one data block pointer according the position of the corresponding storage area; the storage area of each data block in the storage server after duplication removal is arranged; and the data blocks are uploaded to the corresponding storage areas in the storage server. The invention also provides a compression packet uploading and duplication-removing system. Storage space can be saved by utilizing the compression packet uploading and duplication-removing method.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to a file management system and method, in particular to a compressed package upload deduplication system and method. Background technique

[0002] In the cloud technology, when the file uploaded by the user is a compressed file or a packaged file, since the cloud storage process cannot identify whether there is duplicate data in the compressed file or packaged file, it will directly divide the compressed file or packaged file. Chunk upload. As a result, the same data can be uploaded and stored repeatedly, which affects the upload speed and wastes too much storage space. Contents of the invention

[0003] In view of the above, it is necessary to provide a compressed package upload deduplication system, which can effectively deduplicate compressed files or packaged files in the server, so that the server can save more storage space.

[0004] The compressed package upload deduplication system runs on a client, and the client is ...

Examples

Embodiment Construction

[0017] Such as figure 1 As shown, it is a schematic diagram of the operating environment of a preferred embodiment of the compressed package upload deduplication system of the present invention. The compressed package upload deduplication system 100 runs in the client 1, realizes dividing the encrypted compressed package or unencrypted compressed package into blocks, uploads them to the storage server 2, and effectively deletes duplicate data. In this embodiment, the storage server 2 is connected to a hash database 3 , and the storage server 2 can be connected to one or more clients 1 .

[0018] The client 1 also includes a storage device 10 and at least one processing device 12 .

[0019] The storage device 10 is used for storing the computer program code of the compressed package upload deduplication system 100 . The storage device 10 may be a built-in storage of the client 1, or may be an external storage of the client 1.

[0020] The processing device 12 is configured t...