Selective Data Obfuscation and Compaction for Random-Access Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The rapid growth of data storage demand outpaces the capacity to store it, and existing data compression methods are inadequate, especially with multimedia data, leading to storage and transmission bottlenecks.
Innovation Solution
A system and method for scriptable selective obfuscation of records using a data obfuscation module to anonymize personal identifiable information and a data compaction encoder, integrated with a blockchain database for transaction management and data access rights, employing asymmetric encoding/decoding with data manipulation rules.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If traditional data compression methods are used, then storage capacity is doubled, but the method is inadequate for multimedia data and cannot solve the global data storage problem
Solution Approach 1:
The patent transforms data into a different parameter space using hash functions and encoding schemes. Original data is converted through cryptographic hashing and encoding transformations that reduce data size while maintaining the ability to retrieve essential information, enabling effective compression of multimedia data types
Solution Approach 2:
The patent introduces an intermediary encoding layer between original data and stored data. This intermediary representation uses hash structures and encoded formats that serve as a mediator, allowing the system to store compressed versions while maintaining access to original data characteristics without storing the full original data
2Quantity of substance
If data is compacted and stored, then storage efficiency improves, but random access requires unpacking which reduces speed
Solution Approach 1:
The patent divides data into discrete blocks or segments that can be independently processed and accessed. Each data block is encoded separately using the compaction method, allowing the system to access individual segments without decompressing entire data sets, thereby maintaining both compression efficiency and access speed
Solution Approach 2:
The patent performs preliminary encoding and indexing of data during the storage process. Data is pre-processed into a compacted format with embedded metadata and pointers that enable direct access to specific portions without requiring full decompression, preparing the data structure in advance for efficient retrieval
3Productivity
If data is transmitted across networks, then information flows between data centers, but bandwidth limitations create transmission bottlenecks
Solution Approach 1:
The patent transforms data into a more efficient parameter representation for transmission. By converting data into compacted encoded formats with reduced bit requirements, the system decreases the bandwidth necessary for transmission while maintaining the integrity and essential characteristics of the original data
4Quantity of substance
If physical storage capacity is added, then storage demand is temporarily met, but manufacturing capacity cannot keep up with exponential data growth
Solution Approach 1:
The patent changes the fundamental parameter of data representation from full-resolution original data to compacted encoded representations. This parameter transformation enables the same physical storage infrastructure to accommodate exponentially more data by storing efficient representations rather than complete original data sets
Data Source
AI summary
A system and method for scriptable selective obfuscation of records comprising a data obfuscation module configured to identify and perform data anonymization on personal identifiable information (PII) contained within a plurality of records to create a partially-blurred dataset, and further comprising an encoder which receives the partially-blurred dataset and performs data compaction on the partially-blurred dataset before storing the compacted dataset in a data storage system. In some implementations, the data storage system is a blockchain database and the system functions as a clearinghouse to validate and monitor transactions involving data access rights between record owners and third-party entities. The system can further broker such transactions and direct payment form the third-party entity to the record owner when access rights have been purchased.


