Method and system for data deduplication and compression in untrusted storage system

A storage system, reliable technology, applied in digital data protection, electrical digital data processing, special data processing applications, etc., can solve the problem of not allowing data to be deduplicated, and achieve significant cost-effective effects

CN114521260APending Publication Date: 2022-05-20HUAWEI TECH CO LTD
0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Publication Date
2022-05-20

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The present invention provides a method for data deduplication and compression in an untrusted storage system for more efficiently storing a large amount of data in a secure manner by maintaining data integrity. The data deduplication and compression are performed in an untrusted storage system using a system that includes a set of trusted servers that are configured to mutually trust and share a common encryption key.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The present invention generally relates to the field of data protection and backup; more specifically, it relates to a method and system for deduplication and compression of data in an untrusted storage system. Background technique

[0002] Typically, data backups are used to protect and restore data in the event of a data loss event in a primary storage system, such as a server. Examples of data loss events may include, but are not limited to, data corruption, hardware or software failures in primary storage systems, accidental deletion of data, hacking, or malicious attacks. Therefore, separate backup systems or storage systems are widely used to store backups of data present in the primary storage system for security reasons. Typically, as time goes by, when data changes or any new data takes up a lot of storage space in a traditional storage system, the storage space of the storage system will be consumed. This is not advisable as it will degrade...

Examples

Embodiment Construction

[0029] The following detailed description illustrates embodiments of the invention and its implementation. While certain embodiments of the invention have been disclosed, those skilled in the art will recognize that other embodiments for implementing or practicing the invention can be implemented.

[0030] Figure 1A It is a flowchart of a method for deduplication and compression of data in an untrusted storage system provided by an embodiment of the present invention. In one aspect, the present invention provides a method 100A for data deduplication and compression in an untrusted storage system, the method 100A comprising:

[0031] defining a first set of trusted servers, wherein each trusted server in the first set of trusted servers is configured to use a first encryption key and a first hash function;

[0032] separating the data in the trusted server into aligned blocks with a fixed size according to the block size of the compressed data in the untrusted storage system;...