Delimiter-Aware Data Encryption for Local Record Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Computational storage devices struggle to efficiently process and restore data that has been modified, such as compressed or encrypted, as they cannot locally decompress or decrypt data stored in portions, leading to inefficiencies in data retrieval and processing.
Innovation Solution
Implementing a method where data is divided into portions before modification, allowing computational storage devices to perform operations like decryption and decompression locally, and using content-aware techniques to determine portion sizes based on delimiters, enabling efficient data processing and reduction of unnecessary data transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is modified (compressed or encrypted) before being divided into portions, then data security and storage efficiency are improved, but computational storage devices cannot locally decompress or decrypt the data, leading to increased processing time and loss of local processing capability
Solution Approach 1:
The patent divides data into portions after modification (compression or encryption) and stores different portions in different locations. This segmentation enables distributed storage while maintaining the ability to reconstruct and process data locally at computational storage devices, resolving the contradiction between data security through modification and local processing capability.
2Productivity
If data is divided into fixed-size portions, then storage organization and retrieval efficiency are improved, but delimiters indicating record boundaries may be split across portions, requiring additional processing to identify complete records
Solution Approach 1:
The patent dynamically adjusts portion sizes to ensure delimiters are not split across portions. By making the division boundary adaptive rather than fixed, the system maintains complete records within each portion, eliminating the need for complex cross-portion delimiter handling while preserving retrieval efficiency.
3Measurement precision
If data is scanned multiple times to find delimiters and perform compression operations, then data processing accuracy is improved, but processing time increases due to multiple scan operations
Solution Approach 1:
The patent combines delimiter detection and compression operations into a single integrated process. By merging these previously separate scan operations, the system maintains accurate delimiter identification while reducing processing time, as the same data pass serves both purposes simultaneously.
Data Source
Figure 1A~1B
Figure 2A~2B
Figure 3A~3B
AI summary
A method for data encryption may include receiving input data (1268), finding a delimiter (1270, 1271) in the input data (1268), generating, based on a position of the delimiter (1270, 1271) in the input data (1268), a portion of data (1269) using a part of the input data (1268), and encrypting the portion of data (1269). The input data (1268) may include a record, the delimiter (1270, 1271) indicates a boundary of the record, and the portion of data (1269) may include the record. The position of the delimiter (1270, 1271) may be in the part of the input data (1268). Generating the portion of data (1269) may include generating the portion of data (1269) based on a subset of the part of the input data (1268). The part of the input data (1268)may be a first part of the input data (1268), and the position of the delimiter (1270, 1271) may be in a second part of the input data (1268).