Threshold-Based Data Compression for Memory and Sync Bandwidth

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Organizations face challenges in managing memory storage and communication bandwidth due to increasing computing demands, often constrained by aging hardware and software resources, leading to depleted resources and communication delays, especially in financial institutions handling large volumes of electronic transactions.

Innovation Solution

Implementing a system that actively monitors and compresses data structures based on predetermined thresholds, using compression parameters to reduce memory usage and communication bandwidth by generating compressed data structures, thereby minimizing memory and manpower costs, and reducing communication delays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If data is stored in uncompressed format, then data integrity and accessibility are maintained, but memory storage capacity is depleted quickly

Engineering Contradiction:
Improvememory storage capacityVSAvoiddata integrity
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent applies parameter changes by transitioning data from uncompressed to compressed format, altering the storage density parameter. The compression algorithm transforms the data representation while preserving the underlying information, allowing the same logical data to occupy less physical storage space. This resolves the contradiction by changing the storage parameter without compromising data accessibility or integrity.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent creates a compressed copy of the original data that maintains the essential information while reducing storage requirements. The compressed data structure serves as an efficient representation that can be decompressed back to the original format when needed, thus preserving data integrity while improving storage capacity utilization.

Inventive Principle:
Principle #26Copying

2Reliability

If data structures are synchronized in real-time between computing systems, then data consistency is maintained, but communication bandwidth is depleted and delays increase

Engineering Contradiction:
Improvedata consistencyVSAvoidcommunication delays
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent extracts only the essential synchronization information needed to maintain data consistency, rather than transmitting entire data structures. By identifying and transmitting only the critical elements required for synchronization, the communication bandwidth consumption is reduced and transmission delays are minimized while still maintaining data consistency across systems.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the communication parameter by transmitting compressed or differential data representations instead of complete data structures. This parameter change in the communication format reduces the volume of data being transmitted, thereby reducing communication delays while maintaining the ability to achieve consistent state across distributed systems.

Inventive Principle:
Principle #35Parameter changes

3Quantity of substance

If additional storage devices are installed to meet memory requirements, then storage capacity is increased, but manpower and equipment costs increase

Engineering Contradiction:
Improvestorage capacityVSAvoidmanpower and equipment costs
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent changes the storage efficiency parameter through compression, allowing existing storage devices to accommodate more data. By improving the density of data storage through compression algorithms, the system can meet growing storage requirements without adding new hardware, thereby avoiding the associated manpower and equipment costs.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent makes existing storage infrastructure more versatile by implementing compression that allows the same physical storage resources to serve multiple purposes and accommodate larger data volumes. This multi-functional approach to storage utilization delays or eliminates the need for additional storage device acquisitions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11399083B2Adaptive compression of stored data
Publication Date: 2022.07.26 CHICAGO MERCANTILE EXCHANGE INC
  • US11399083B2 patent drawing
  • US11399083B2 patent drawing
  • US11399083B2 patent drawing

AI summary

Systems, devices and methods for adaptive compression of stored information includes a memory management computing device programmed to monitor a size of a plurality of data structures stored in a data repository. The computing device compares the size of each of a plurality of data structures to a predetermined threshold. When a size of an uncompressed data structure meets the threshold, the memory management computing device calculates a value of a first compression parameter based on a value of a first parameter and a value of a second parameter of each data element of the uncompressed data structure, calculates a value of a second compression parameter based the value of the first parameter of each data element of the uncompressed data structure, generates a compressed data structure based on the value of the first compression parameter and the second compression parameter; and replaces, in the data repository, the uncompressed data structure with the compressed data structure.