Codeword Mapping for Random Access in Compressed Encrypted Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The rapid growth of data storage demand outstrips the capacity to store it, with existing solutions like physical storage expansion and data compression being inadequate, and transmission bandwidth becoming a bottleneck, especially for large data sets and low-bandwidth devices.
Innovation Solution
A system and method for extracting data from compressed and encrypted data streams using lossless compression and codeword-to-byte mapping, enabling selective random access to specific data segments while maintaining data integrity and confidentiality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data compression is used to reduce storage demand, then storage capacity utilization improves, but data retrieval efficiency deteriorates due to the need to decompress entire datasets
Solution Approach 1:
The patent divides the compressed data stream into discrete codeword units, each representing a specific byte range in the original data. This segmentation allows the system to retrieve only the codewords corresponding to requested data portions rather than decompressing the entire dataset, thus maintaining both storage efficiency and retrieval speed.
Solution Approach 2:
The system pre-computes and stores a mapping table that associates each codeword with its corresponding byte range in the original uncompressed data. This preliminary action enables rapid identification and extraction of specific data segments during retrieval operations without requiring full decompression.
2Reliability
If encryption is applied to protect data confidentiality, then security improves, but random access capability deteriorates
Solution Approach 1:
The encrypted data is organized into discrete codeword units, each independently decryptable. The mapping table allows the system to identify and decrypt only the specific codewords containing the requested byte range, enabling random access to encrypted data without decrypting the entire dataset.
Solution Approach 2:
The mapping table serves as an intermediary structure that bridges the encrypted codeword domain and the original byte domain. It enables the system to translate byte range requests into specific codeword identifiers, facilitating efficient random access to encrypted data while maintaining security.
3Ease of operation
If full dataset decompression is performed to access specific data, then data access completeness improves, but processing time and computational resources worsen
Solution Approach 1:
The system extracts and processes only the specific codewords containing the requested byte range from the compressed and encrypted data stream. By using the mapping table to identify relevant codewords, the system avoids the unnecessary computational overhead of decompressing and decrypting the entire dataset, significantly reducing processing time while maintaining access completeness.
4Quantity of substance
If traditional compression methods are used, then storage efficiency improves, but transmission bandwidth requirements deteriorate for large datasets
Solution Approach 1:
The patent compresses data into discrete codeword units that can be independently transmitted and stored. This segmentation allows for efficient storage utilization while enabling selective transmission of only the codewords containing requested data, reducing the bandwidth required for transmitting large datasets compared to traditional methods that require transmitting or decompressing entire datasets.
Data Source
AI summary
Data is extracted from a compressed and encrypted data stream employing lossless compression and a codeword-to-byte mapping enables selective random extraction from compressed and encrypted data. Initially, data is compressed to reduce its size without information loss. A codeword-to-byte mapping table is created, associating codewords with specific positions in the compressed data. When a request for a specific byte range is received, the system uses the mapping to identify the codewords linked to that range within the compressed data. The system then selectively decompresses the identified codewords and subsequently decrypts the decompressed data.