Adaptive Data Compression for Memory and Bandwidth Constraints

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Organizations face challenges in managing memory storage and communication bandwidth due to increasing computing resources demands, particularly in financial institutions handling large volumes of electronic transactions, which can lead to memory depletion and communication slowdowns.

Innovation Solution

Implementing a system that actively monitors and compresses data structures based on predetermined thresholds, using compression parameters to reduce memory usage and communication bandwidth by generating compressed data structures, thereby minimizing memory and manpower costs and communication delays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If data is stored in uncompressed format to maintain data integrity and accessibility, then data quality and reliability are improved, but memory storage capacity is depleted faster

Engineering Contradiction:
Improvedata integrityVSAvoidmemory storage capacity
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent applies parameter changes by transitioning data between compressed and uncompressed states based on access patterns. Data is stored in compressed format to conserve memory capacity, then selectively decompressed to uncompressed format when access is required, maintaining data integrity while optimizing storage utilization.

Inventive Principle:
Principle #35Parameter changes

2Speed

If data is stored in uncompressed format to enable fast processing, then processing speed is improved, but communication bandwidth is consumed faster

Engineering Contradiction:
Improveprocessing speedVSAvoidcommunication bandwidth
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

The patent applies preliminary action by pre-decompressing data that is likely to be accessed soon based on predicted access patterns. This ensures that frequently accessed data is already in uncompressed format when needed, maintaining processing speed while reducing the frequency of decompression operations and associated communication overhead.

Inventive Principle:
Principle #10Preliminary action

3Quantity of substance

If additional storage devices are added to meet memory demands, then memory capacity is increased, but hardware costs and system complexity increase

Engineering Contradiction:
Improvememory capacityVSAvoidhardware infrastructure
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent applies self-service by implementing automated compression and decompression operations that occur without manual intervention. The system automatically monitors data access patterns, applies compression to conserve storage capacity, and selectively decompresses data when needed, eliminating the need for additional hardware while maintaining adequate memory capacity.

Inventive Principle:
Principle #25Self-service

4Quantity of substance

If data is compressed to reduce memory usage, then storage capacity is extended, but data access time increases

Engineering Contradiction:
Improvestorage capacityVSAvoiddata access time
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

The patent applies dynamics by making the data compression state adaptive rather than static. Data is dynamically transitioned between compressed and uncompressed formats based on real-time access patterns and predicted future access needs, optimizing the balance between storage capacity utilization and data access speed.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11700316B2Adaptive compression of stored data
Publication Date: 2023.07.11 CHICAGO MERCANTILE EXCHANGE INC
  • US11700316B2 patent drawing
  • US11700316B2 patent drawing
  • US11700316B2 patent drawing

AI summary

Systems, devices and methods for adaptive compression of stored information includes a memory management computing device programmed to monitor a size of a plurality of data structures stored in a data repository. The computing device compares the size of each of a plurality of data structures to a predetermined threshold. When a size of an uncompressed data structure meets the threshold, the memory management computing device calculates a value of a first compression parameter based on a value of a first parameter and a value of a second parameter of each data element of the uncompressed data structure, calculates a value of a second compression parameter based the value of the first parameter of each data element of the uncompressed data structure, generates a compressed data structure based on the value of the first compression parameter and the second compression parameter; and replaces, in the data repository, the uncompressed data structure with the compressed data structure.