Deterministic Data Substitution for Database Obfuscation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for database obfuscation, such as random data substitution, fail to replicate the actual data distribution found in natural databases, leading to potential security breaches and inefficient troubleshooting due to the need for access to sensitive information.
Innovation Solution
A deterministic method and system that generates pseudo-random data values mirroring the distribution of original data by creating a data string for each row, mapping it to a reference data structure, and populating a synthetic data structure, ensuring reproducible results and maintaining the confidentiality of original data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If random data substitution is used to obfuscate databases, then data confidentiality is improved, but data distribution accuracy deteriorates
Solution Approach 1:
The patent creates a copy of the original data distribution pattern through deterministic substitution. Instead of random replacement, the system generates synthetic data that replicates the statistical properties, value ranges, and distribution characteristics of the original sensitive data, thereby maintaining data distribution accuracy while protecting confidentiality
Solution Approach 2:
The system transforms the obfuscation approach by changing from random parameter substitution to deterministic parameter transformation. By applying deterministic functions that preserve distributional parameters (mean, variance, skewness) while altering individual values, the system maintains both confidentiality and distribution accuracy
2Productivity
If actual sensitive data is accessed for troubleshooting, then troubleshooting effectiveness is improved, but security risk increases
Solution Approach 1:
The patent introduces synthetic test data as an intermediary between the troubleshooting process and the original sensitive data. This intermediary allows programmers to access and analyze data distributions for effective troubleshooting without directly accessing actual sensitive information, thereby eliminating security risks while maintaining troubleshooting effectiveness
Solution Approach 2:
The system creates accurate copies of data distributions that can be used for troubleshooting purposes. These synthetic copies replicate the statistical properties and patterns of the original data sufficiently for debugging and testing, eliminating the need to access actual sensitive data
3Measurement precision
If deterministic substitution is used to generate test data, then data distribution accuracy is improved, but data variability decreases
Solution Approach 1:
The patent implements a dynamic deterministic substitution system where the deterministic function can be configured with different parameters, seeds, and transformation rules. This allows the system to adapt to different data types, distribution patterns, and testing requirements while maintaining determinism, thereby preserving both distribution accuracy and data variability
Data Source
AI summary
A method and system create a data structure from an obfuscated data structure. First, the system operates on a first data structure whose obfuscation is desired, and creates a data string based on a portion of the first data structure. Next, based on the data string, a second data structure is deterministically generated from a third data structure and the second data structure replaces the first data structure.