User Data Fragment Storage with Non-Deterministic ID Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data storage systems face challenges in providing privacy and security for user data, particularly in ensuring that user data is not persistently stored in a way that allows it to be traced back to individual users, while also allowing for data analysis and processing.
Innovation Solution
A data storage system generates fragment records for user devices based on event data, using non-deterministic IDs and a chain ID to associate fragments, and implements a retention policy to disassociate fragments based on age, ensuring that user data is not persistently linked to individual users while allowing for data processing and analysis.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If user data is stored with persistent identifiers for long-term tracking and analysis, then data analysis capability is improved, but user privacy and security deteriorate
Solution Approach 1:
The patent segments user data into temporary fragment records that are stored in isolation without persistent identifiers. Each fragment record contains only event data for a specific time period and is automatically deleted after a defined retention period, preventing long-term tracking while preserving short-term analysis capability
Solution Approach 2:
The patent introduces chain IDs as intermediary identifiers that temporarily link fragment records during the retention period without exposing user identity. These chain IDs enable data analysis across multiple fragments while maintaining privacy, as they cannot be traced back to individual users after the retention period expires
2Loss of information
If fragment records are retained indefinitely for comprehensive data analysis, then data analysis capability is improved, but data security and privacy protection deteriorate
Solution Approach 1:
The patent implements dynamic retention policies where fragment records are automatically deleted after a defined retention period. This dynamic approach balances data completeness for analysis during the retention period with privacy protection after deletion, ensuring that data is available when needed but removed when no longer necessary
Solution Approach 2:
The patent employs periodic deletion of fragment records based on retention periods. This periodic action ensures that data is systematically removed at regular intervals, maintaining a balance between having sufficient data for analysis and protecting user privacy through automatic expiration
3Productivity
If deterministic ID generation is used for fragment records, then data processing efficiency is improved, but user privacy deteriorates due to traceability
Solution Approach 1:
The patent uses asymmetric identification where fragment IDs are generated non-deterministically to prevent traceability, while chain IDs provide symmetric linking for analysis purposes. This asymmetry ensures that individual fragments cannot be traced back to users while still enabling efficient group-level data processing and analysis
Data Source
AI summary
A method includes sequentially generating fragment records for a user device according to fragment generation rules specifying that each subsequent fragment record be generated for user device events that occur within a defined period of time. Each fragment record includes event data for a series of user device events and includes a fragment ID generated using a non-deterministic ID generation algorithm. The method includes generating an ID-fragment record associating a chain ID with the fragment IDs. The chain ID is associated with device IDs that identify the user device. The method includes removing associations between the chain ID and fragment IDs according to removal parameters indicating that associations be removed based on an age of the fragment records. The method includes generating at least one of search results and advertisements for the user device based on the event data in the fragment records that remain associated with the chain ID.