LOB Data Encryption with Block-Level Segmentation and De-duplication
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for storing LOB data face challenges such as duplicated storage, inefficient use of disk space, and lack of random access to compressed data, as well as the unencrypted storage of sensitive information, which leads to storage space management issues and security concerns.
Innovation Solution
A system that processes data by obtaining and encrypting file portions, allowing individual access and storage, while implementing de-duplication and compression techniques to minimize storage needs and ensuring secure storage through encryption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If LOB data is stored uncompressed, then random access to data is easier, but disk space requirements increase significantly
Solution Approach 1:
The patent divides the LOB data into multiple fixed-size blocks (e.g., 4KB each). Each block is independently compressible and accessible, allowing random access to specific blocks without decompressing the entire file. This segmentation resolves the contradiction by enabling both compression efficiency and random access capability.
Solution Approach 2:
The patent pre-compresses data blocks during the initial storage phase and maintains compression metadata (compression maps) that enable direct access to compressed blocks. This preliminary compression action eliminates the need to decompress entire files for partial access, simultaneously achieving space efficiency and random access.
2Quantity of substance
If data compression is applied to LOB data, then disk space requirements are reduced, but random access to compressed data becomes difficult
Solution Approach 1:
By segmenting compressed data into fixed-size blocks with associated compression maps, the system enables direct access to individual compressed blocks without decompressing the entire file. The compression maps store metadata that allows the system to locate and access specific compressed blocks randomly.
Solution Approach 2:
The patent introduces compression maps as an intermediary data structure that bridges the gap between compressed data and random access requirements. These maps contain metadata about compressed block locations and characteristics, enabling efficient random access to compressed data without full decompression.
3Speed
If LOB data is stored unencrypted, then processing and access speed are faster, but security and compliance requirements are not met
Solution Approach 1:
The patent applies encryption selectively at the block level rather than encrypting entire files. Only the portions of data that require security protection are encrypted, while maintaining the ability to process and access unencrypted portions efficiently. This local quality approach balances security requirements with processing speed.
Solution Approach 2:
By segmenting data into blocks and applying encryption at the block level, the system can encrypt only sensitive portions while leaving other portions unencrypted for faster processing. This granular encryption approach maintains security for protected data while preserving processing efficiency for non-sensitive data.
4Ease of operation
If duplicate LOB data is stored, then data access and retrieval are simpler, but storage space is wasted
Solution Approach 1:
The patent implements de-duplication by identifying and eliminating duplicate data blocks across files. Instead of storing multiple copies of identical data, the system stores a single copy and maintains references to it, reducing storage space while preserving data accessibility through reference mechanisms.
Data Source
AI summary
A method of processing data from a file includes obtaining a first portion of the file, encrypting the first portion of the file to create a first encrypted portion, obtaining a second portion of the file, encrypting the second portion of the file to create a second encrypted portion, and storing the first and second encrypted portions such that each of the first and the second encrypted portions can be individually accessed. A method of processing data from a file includes receiving a request to access a first portion of the file, wherein data in the first portion of the file is encrypted, and data in a second portion of the file is encrypted, and decrypting the data in the first portion, and not the data in the second portion.