Secure Deduplication Filter Generation via Permutation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current secure computation techniques lack a method to eliminate duplication of attribute values in tables while maintaining secrecy.
Innovation Solution
A secure deduplication filter generation system comprising secure computation apparatuses that generate a permutation-based filter to eliminate duplication, using permutation calculation, application, vector generation, and inverse permutation application parts to sort and process attribute vectors, ensuring secrecy throughout the process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional secure computation techniques are used, then secrecy is maintained, but duplication elimination capability is lost
Solution Approach 1:
The invention segments the deduplication process into multiple secure computation steps: permutation calculation, permutation application, vector generation, and inverse permutation application. Each step operates on shared secret data without revealing underlying values, enabling duplication elimination while maintaining secrecy through incremental processing of segmented operations.
Solution Approach 2:
The invention introduces permutation vectors and position vectors as intermediary elements that mediate between the secret data and the deduplication logic. These intermediaries allow the system to identify and eliminate duplicates without directly comparing or revealing the underlying secret attribute values, thus maintaining secrecy while achieving deduplication.
2Productivity
If duplication elimination is performed using conventional methods, then duplicates are removed, but secrecy of attribute values is compromised
Solution Approach 1:
The invention replaces conventional mechanical comparison-based deduplication methods with a cryptographic computation system. Instead of directly comparing attribute values to identify duplicates, the system uses permutation calculations and vector operations on shared secret data, substituting mechanical comparison with cryptographic transformations that preserve secrecy.
Solution Approach 2:
The invention changes the parameters of computation by operating on permutation vectors and position indicators rather than on the original secret attribute values themselves. This parameter transformation allows deduplication logic to function on transformed data that does not reveal the underlying secrets, maintaining secrecy while enabling efficient duplicate identification and removal.
3Speed
If a simple filter is used for deduplication, then processing is fast, but secrecy cannot be maintained
Solution Approach 1:
The invention performs preliminary permutation calculations and vector generations on shared secret data before the actual deduplication filtering occurs. These preliminary actions prepare the data in a form that enables fast filtering operations while ensuring that the secret values themselves are never exposed during the filtering process, thus maintaining both speed and secrecy.
Data Source
AI summary
A secure deduplication system, including a plurality of secure computation apparatuses, wherein the plurality of secure computation apparatuses include a plurality of permutation calculation parts 11n for generating a share {{σ}} of a permutation σ that stably sorts a vector v in ascending order, a plurality of permutation application parts 12n for generating a share [σ(v)] of a vector σ(v) obtained by applying the permutation σ to the vector v, a plurality of vector generation parts 13n for generating a share [e] of a vector e that has 1 as an element corresponding to a certain element when the certain element of the vector σ(v) and an element before the certain element are different, and has 0 otherwise, and a plurality of inverse permutation application parts 14n for generating a share [σ−1(e)] of a vector σ−1(e) obtained by applying an inverse permutation σ−1 of the permutation σ to the vector e.