Dynamic Integer Compression Using Elias Delta Code Updates

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing dynamic lossless data compression systems face challenges in efficiently compressing unbounded integers without prior knowledge of their magnitude or probability distribution, leading to suboptimal performance in representing and encoding such integers.

Innovation Solution

The implementation of dynamic Huffman, Tunstall, Arithmetic, Shannon Fano Elias, LZ77, LZ78, and LZW compression methods utilizing Elias delta codes to differentiate between encountered and unencountered integers, updating codes and counters to reflect the occurrence of integers in the data stream, and employing flag bits or exception codes to manage the encoding and decoding processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If dynamic compression methods are used to compress unbounded integers without prior knowledge of their magnitude or probability distribution, then the system can handle a wider range of data, but the compression efficiency deteriorates

Engineering Contradiction:
Improveability to handle unbounded integersVSAvoidcompression efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent implements dynamic compression methods where the encoding model is continuously updated during the compression process. The system adapts to the actual data distribution by maintaining and updating probability estimates for unbounded integers, allowing it to handle diverse data ranges while improving compression efficiency over time through learned patterns.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes encoding parameters dynamically based on observed data characteristics. By adjusting probability distributions and encoding schemes according to the actual magnitude and frequency of unbounded integers encountered, the system optimizes compression efficiency for each specific data set while maintaining versatility.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If static compression techniques with shared predictive models are used, then compression efficiency improves when data matches the model, but the system loses flexibility in handling unexpected data

Engineering Contradiction:
Improvecompression efficiencyVSAvoidability to handle unexpected data
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent transitions from static to dynamic compression by implementing models that evolve during operation. The system starts with initial probability estimates and continuously refines them based on observed data, enabling it to achieve high compression efficiency for expected data while adapting to handle unexpected values that fall outside the initial model assumptions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system incorporates feedback mechanisms where compression performance and observed data patterns are used to update the predictive model. This feedback loop allows the system to maintain high efficiency for common data patterns while becoming progressively better at handling unexpected data, resolving the contradiction between efficiency and adaptability.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10340945B2Memory compression method and apparatus
Publication Date: 2019.07.02 SILICONIP INC
  • US10340945B2 patent drawing
  • US10340945B2 patent drawing
  • US10340945B2 patent drawing

AI summary

Methods and systems for encoding of integers are discussed. For example, various methods and systems may utilize Huffman coding, Tunstall coding, Arithmetic Coding, LZ77 coding, LZ78 coding, LW coding, or Shannon Fano Elias coding to encode the integers.