Privacy-Preserving Data Deduplication with Encrypted Comparison
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems struggle to compare encrypted sensitive data for deduplication without revealing plaintext, making it difficult to identify and remove duplicate data while maintaining user privacy.
Innovation Solution
A server computer receives encrypted data from multiple data provider computers, determines duplicates using intermediate data derived from encrypted identity data, and removes duplicates from its memory without decrypting the data, utilizing cryptographic keys and homomorphic encryption to maintain privacy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If encrypted data is compared directly to enable deduplication, then data privacy is maintained, but comparison accuracy and deduplication effectiveness deteriorate
Solution Approach 1:
The patent introduces an intermediary mechanism where a third party (server) receives encrypted data from multiple data providers, performs comparison operations on the encrypted data without decrypting it, and returns comparison results. This intermediary approach allows accurate comparison of encrypted data while maintaining privacy, as the server never accesses the plaintext data. The server acts as a mediator that enables deduplication without compromising the confidentiality of the underlying identity data.
2Object-affected harmful factors
If data is encrypted to protect user privacy, then security is improved, but data processing and comparison capability deteriorate
Solution Approach 1:
The patent replaces traditional mechanical data processing (requiring decryption) with a cryptographic substitution system. Instead of decrypting data to process it, the system uses cryptographic operations on encrypted data directly. The server performs comparison operations on encrypted data using cryptographic algorithms, eliminating the need for decryption while maintaining processing capability. This substitution of processing mechanisms allows secure data handling without sacrificing operational ease.
3Quantity of substance
If multiple encrypted data sources are processed to enable comprehensive deduplication, then data completeness is improved, but system complexity and computational overhead increase
Solution Approach 1:
The patent segments the data processing task by introducing multiple independent data providers, each holding encrypted data from different sources. The server coordinates these segmented data sources, receiving encrypted data from each provider and performing comparisons across all sources. This segmentation allows comprehensive deduplication across multiple data sources while maintaining manageable system complexity through modular architecture, where each data provider operates independently and the server orchestrates the overall process.
Data Source
AI summary
A method includes a server computer receiving, from a first data provider computer, encrypted data derived from first identity data and a cryptographic key or derivative thereof stored at the first data provider computer. The server computer transmits, to a second data provider computer, the encrypted data and/or the cryptographic key or derivative thereof. The server computer receives, from the second data provider computer, intermediate data derived from second identity data stored at the second data provider computer. The server computer determines if the first identity data and the second identity data are duplicates while the first identity data and the second identity data are encrypted. The server computer removes one of encrypted first identity data, derived from the first identity data, and encrypted second identity data, derived from the second identity data, from a memory in the server computer.