Logical Data Object Compression with Indexed Secure Storage

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current storage technologies face challenges in efficiently compressing and encrypting logical data objects while maintaining data accessibility and manageability, with existing solutions often compromising on performance or security.

Innovation Solution

A method and system that compresses raw logical data objects into compressed sections with adaptive dictionaries, facilitates mapping between raw and compressed data, and encrypts data using block cipher algorithms, ensuring efficient storage and secure access through the use of index sections and flags for data management.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If data compression is applied to reduce storage capacity, then storage efficiency is improved, but data accessibility and manageability deteriorate

Engineering Contradiction:
Improvestorage capacityVSAvoiddata accessibility
Core Design Contradiction:
Quantity of substanceVSEase of operation

Solution Approach 1:

The patent divides the compressed data into multiple sections with index structures, allowing selective access to specific data portions without decompressing the entire dataset. This segmentation enables efficient random access while maintaining compression benefits.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces index sections as intermediary structures that map compressed data locations to original data positions. These indexes act as mediators between the compressed storage format and the application's data access requirements, preserving accessibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If encryption is applied to enhance security, then data protection is improved, but processing speed and accessibility deteriorate

Engineering Contradiction:
Improvedata securityVSAvoidprocessing speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent segments encrypted data into blocks that can be processed independently using block cipher algorithms. This allows parallel processing of multiple blocks simultaneously, maintaining security while improving overall processing throughput.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs encryption/decryption operations in advance during data storage and retrieval operations, so that data is already in the required cryptographic state when needed, eliminating delays during critical access operations.

Inventive Principle:
Principle #10Preliminary action

3Quantity of substance

If both compression and encryption are applied to optimize storage and security, then storage efficiency and data protection are improved, but system complexity deteriorates

Engineering Contradiction:
Improvestorage efficiencyVSAvoidsystem complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent combines compression and encryption operations into a unified processing pipeline with shared data structures and management mechanisms. This integration reduces redundant operations and simplifies the overall system architecture while maintaining both compression and encryption benefits.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent designs a multi-functional system that handles compression, encryption, indexing, and data management through a single integrated architecture. This universal approach eliminates the need for separate independent systems, reducing overall complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Quantity of substance

If adaptive dictionaries are used to improve compression ratios, then storage capacity is reduced, but processing time increases

Engineering Contradiction:
Improvestorage capacityVSAvoidprocessing time
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

The patent implements adaptive dictionaries that are customized for specific data types and access patterns rather than using a single universal dictionary. This local optimization allows faster processing for common data patterns while maintaining high compression ratios.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent employs dynamically adjustable dictionary structures that can be modified based on the characteristics of the data being processed. This dynamic adaptation allows the system to optimize both compression ratio and processing speed according to the specific data being handled.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10372680B2Systems and methods for transformation of logical data objects for storage
Publication Date: 2019.08.06 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10372680B2 patent drawing
  • US10372680B2 patent drawing
  • US10372680B2 patent drawing

AI summary

Systems and methods for compressing a raw logical data object (201) for storage in a storage device operable with at least one storage protocol, creating, reading, writing, optimizatic in and restoring thereof. Compressing the raw logical data object (201) comprises creating in the storage device a compressed logical data object (203) comprising a header (204) and one or more allocated compressed sections with predefined size (205-1-205-2); compressing one or more sequentially obtained chunks of raw data (202-1-202-6) corresponding to the raw logical data object (201) thus giving rise to the compressed data chunks (207-1-207-6); and sequentially accommodating the processed data chunks into: said compressed sections (205-1-205-2) in accordance with an order said chunks received, wherein said compressed sections serve as atomic elements of compression/decompression operations during input/output transactions on the logical data object.