Data Chunk Encryption and Compression for Storage Security
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Computing systems face challenges in efficiently storing data due to the large storage space requirements of uncompressed data and the security risks associated with plaintext data, which can be compromised if lost or stolen.
Innovation Solution
A process of encrypting and compressing data streams into chunks with metadata for storage, allowing for efficient use of storage space and secure data protection by identifying starting locations and providing decryption and decompression information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored as uncompressed plaintext, then storage space consumption is high, but data security is compromised
Solution Approach 1:
The patent segments data into fixed-size chunks before compression and encryption. Each chunk is processed independently, allowing efficient storage and retrieval while maintaining both security and space efficiency. The segmentation enables the system to apply compression algorithms effectively while ensuring that even if one chunk is compromised, the entire dataset remains secure.
Solution Approach 2:
The patent applies compression and encryption to data chunks before storing them on external media. By performing these security and optimization operations in advance (preliminary action), the system ensures data is secured and space-efficient before leaving the controlled environment, preventing both security breaches and storage waste.
2Reliability
If data is compressed for storage, then storage space efficiency improves, but data security remains vulnerable if stored as plaintext
Solution Approach 1:
By dividing data into manageable chunks, the patent simplifies the encryption process while maintaining security. Each chunk can be encrypted independently using standard algorithms, making the overall system secure without requiring overly complex encryption schemes for the entire dataset at once.
Solution Approach 2:
The patent introduces metadata as an intermediary layer that stores information about compressed and encrypted chunks without containing the actual data. This metadata structure simplifies the retrieval and decryption process by providing a roadmap of where and how to access encrypted data, reducing processing complexity while maintaining security.
3Reliability
If encryption is applied to all data chunks, then data security is improved, but storage space efficiency may be reduced due to metadata overhead
Solution Approach 1:
The patent applies encryption selectively based on the sensitivity and type of data in each chunk. Not all data requires the same level of security, so the system can optimize storage efficiency by applying encryption only where necessary while maintaining security for sensitive information. This local approach to encryption reduces overall metadata overhead.
Solution Approach 2:
The patent allows the encryption and compression parameters to be adjusted based on data characteristics. By changing parameters such as chunk size, compression level, and encryption strength according to the specific data being stored, the system optimizes the balance between security and storage efficiency for different types of data.
Data Source
AI summary
Described is a process for encrypting and compressing data for storage by computing systems. A data stream received by a computing system is separated into data chunks for storage on a storage device using a data layout format. Each data chunk is examined and if possible, compressed to produce a compressed data chunk. Whether or not the data chunk can be compressed, the data chunk is encrypted and stored on the storage device in addition to metadata that describes the data chunk. When reading the stored data chunk from the storage device, the metadata identifies the starting location of the stored data chunk and provides metadata information to the computing system for decryption and decompression processing.