AI-Based Data Encoding for Format-Preserving Secure Sharing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for sharing sensitive data often result in loss of data granularity and format, making it unusable for analysis, while conventional de-identification techniques degrade accuracy and break existing process pipelines.
Innovation Solution
A system that encodes sensitive data elements using a customizable and flexible algorithm, preserving their format and distribution, allowing for cross-domain interoperability and analysis without decoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional de-identification techniques are used to protect sensitive data, then security is improved, but data granularity and format are lost making it unusable for analysis
Solution Approach 1:
The patent introduces an encoded representation as an intermediary between the original sensitive data and the analysis process. This encoded form acts as a mediator that preserves data utility while protecting sensitivity, allowing analysis to proceed on the encoded data without exposing the original sensitive information.
Solution Approach 2:
The patent transforms the data by changing its parameters through encoding, which modifies the data representation while preserving its structural and statistical properties. This allows the encoded data to maintain analytical utility while the original sensitive parameters remain protected.
2Reliability
If conventional de-identification techniques are used to protect sensitive data, then security is improved, but existing process pipelines are broken
Solution Approach 1:
The encoding process changes data parameters in a way that preserves format compatibility, allowing the encoded data to flow through existing process pipelines without breaking them. The transformation maintains the data structure and statistical properties needed by downstream processes.
Solution Approach 2:
The encoded representation serves multiple functions simultaneously: it protects sensitive data, maintains format compatibility with existing pipelines, and preserves analytical utility. This multi-functionality allows a single solution to address multiple requirements without requiring pipeline modifications.
3Reliability
If data is encoded to protect sensitive information, then security is improved, but the ability to use data in analysis without decoding must be preserved
Solution Approach 1:
The encoding transforms data parameters while preserving the statistical and structural properties necessary for analysis. This allows analytical operations to be performed directly on the encoded data using the same algorithms and processes, maintaining ease of operation while improving security.
Solution Approach 2:
The patent creates an encoded copy of the original data that retains the essential properties needed for analysis. This copy can be used independently for analytical purposes without requiring access to or decoding of the original sensitive data, thus improving security while maintaining analysis usability.
Data Source
AI summary
Implementations provide a secure and flexible encoding technique that enables data set owners to share data without losing interoperability or breaking data constraints. A device may receive a request to encode an input that includes a plurality of data portions. A device may identify protected data types within the data portions, transform raw text corresponding to a protected data type based on a seed and a base set to encoded text, and include the encoded text in an output. The seed and/or base set can be selected by a requester. The output configuration can be defined as different from the configuration of the input. The encoded text retains a format of the raw text so the encoded text does not violate existing data constraints. The device may also ensure a minimum level of fidelity in the encoded text.