Secure Data De-duplication via Shared Secret Regeneration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Data de-duplication systems face concerns regarding data integrity and unauthorized access during data backup, de-duplication, and restoration processes, particularly due to the potential for hash collisions and malicious attacks.
Innovation Solution
The implementation of a method and apparatus that uses cryptographic protocols such as Diffie-Hellman key-agreement and AES encryption to securely process and restore data files, including the regeneration of shared secrets and decryption of keys, ensuring data integrity and security through secure communication protocols like CRC, SHA-1, and SSL/TLS.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data de-duplication is implemented to reduce storage capacity, then storage efficiency is improved, but data integrity and security are compromised
Solution Approach 1:
The patent applies preliminary action by performing cryptographic hashing and integrity verification before data is written to storage. Hash values are calculated and stored metadata are created in advance, allowing the system to verify data integrity before de-duplication occurs, thus preventing integrity issues from arising in the first place
Solution Approach 2:
The patent introduces cryptographic hash functions and metadata as intermediaries between the original data and the de-duplicated storage. These intermediaries serve as verification mechanisms that prove data integrity without requiring storage of redundant copies, allowing the system to maintain reliability while achieving de-duplication
2Productivity
If cryptographic hash functions are used to identify duplicate data segments, then de-duplication efficiency is improved, but hash collisions may cause data corruption
Solution Approach 1:
The patent applies parameter changes by using hash values with sufficiently large bit lengths (e.g., 128-bit or 256-bit hashes) to make the probability of collisions negligibly small. By changing the parameter of hash function output size, the system maintains high de-duplication efficiency while eliminating practical concerns about collisions causing data corruption
3Quantity of substance
If user data is processed for de-duplication, then storage costs are reduced, but vulnerability to unauthorized access increases
Solution Approach 1:
The patent applies preliminary anti-action by implementing encryption and access control mechanisms before data is made vulnerable to unauthorized access. Cryptographic protocols are established in advance, and access permissions are configured before de-duplication processing occurs, creating a security framework that prevents unauthorized access rather than reacting to it later
Solution Approach 2:
The patent introduces cryptographic protocols and access control metadata as intermediaries between the de-duplication system and the stored data. These intermediaries maintain security by ensuring that only authorized users can access the de-duplicated data, thus reducing storage costs without increasing vulnerability to unauthorized access
Data Source
AI summary
Disclosed are an apparatus and method of restoring at least one data file. The method may include retrieving the at least one data file to be restored from a data storage location, determining that the at least one data file is a link file, and regenerating a previously exchanged shared secret. The method may also include decrypting a key from the link file using the shared secret, and retrieving data from a data repository location to be restored.