Efficient and safe data deduplication method and efficient and safe data deduplication system based on user perception

Abstract

The invention provides an efficient and safe data deduplication method based on user perception, which comprises the steps that a client adopts key server assisted Hash-based convergence encryption to carry out file-level data deduplication across users; if duplication does not exists in files, user assisted convergence encryption is adopted to carry out block-level deduplication inside the users; and multilevel key management is adopted, a file-level secret key is used to encrypt a block-level secret key, the file-level secret key is segmented into fragment-level secret keys by using secret sharing, and the fragment-level secret keys are stored in a distributed key server. The invention further provides an efficient and safe data deduplication system based on user perception. According to the invention, random information is added through adopting key server assisted Hash-based convergence encryption in a file level and adopting user assisted convergence encryption in a block level, thereby enabling file-level secret keys and block-level secret keys of users to be randomized, being capable of effectively resisting brute force attacks of opponents, and ensuring the data confidentiality and the safety of the users; and the multilevel key management scheme is adopted to ensure the safety of secret keys, and the secret key space overhead is reduced.

Description

technical field [0001] The invention belongs to the field of computer storage, and more specifically relates to a method and system for deduplication of efficient and secure data based on user perception. Background technique [0002] In recent years, with the rapid development of cloud computing, more and more users and enterprises back up their data to cloud storage. IDC predicts that by 2020, the scale of global electronic data will exceed expectations, reaching 44ZB. A large number of recent studies and investigations have shown that there is a large amount of duplicate data among different users and within users in storage systems, especially in backup systems. The growth of online digital content has led to an increase in the cost of storage systems including hardware and human maintenance. It is extremely important to reduce the amount of data in the process of transmission and storage management. Cloud backup systems usually store and operate several copies of the ...

AI Technical Summary

Problems solved by technology

The DupLESS method is only suitable for file-level deduplication, and there is a huge computational overhead for block-level deduplication

Second, cutting-edge convergent key management schemes have many limitations, including huge key space overhead and single points of failure

At the same time, in order to ensure the security of the key, users usually use their own private key to encrypt the key of the data block, so that the user's private key has a single point of failure problem

Images