Multi-Stage Adder Decoder for Low-Latency Delta Decoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing delta decoding techniques require n sequential decoding operations to decode n item chunks, leading to high latency.

Innovation Solution

A decoder unit with multiple stages of adders that perform parallel operations, reducing the number of stages to log2(n) while maintaining the total number of adders, thereby decreasing latency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If sequential decoding operations are used to decode delta encoded data, then the decoding process is simple to implement, but the latency is high due to n sequential operations required for n items

Engineering Contradiction:
Improvedecoding latencyVSAvoiddecoder structure complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The decoder divides the decoding process into multiple stages, where each stage processes a subset of the encoded items. For example, with 8 encoded items, the decoder uses multiple stages with varying numbers of adder circuits to process different portions of the data in parallel, reducing the total decoding latency from sequential n operations to log2(n) stages.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from a one-dimensional sequential processing approach to a multi-dimensional parallel processing structure. By organizing adder circuits across multiple stages with different counts (e.g., stage 0 has 7 adders, stage 1 has 3 adders, stage 2 has 1 adder for 8 items), the decoder exploits the dimensional aspect of parallelism to simultaneously perform multiple decoding operations that would otherwise be sequential.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If parallel decoding operations are implemented to reduce latency, then the decoding speed increases, but the number of adder circuits and device complexity increases

Engineering Contradiction:
Improvedecoding throughputVSAvoidnumber of adder circuits
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The decoder employs a dynamic structure where the number of adder circuits varies across stages rather than being uniform. Each successive stage has fewer adder circuits than the previous stage, creating an asymmetric, dynamic architecture that optimizes the balance between parallel processing capability and hardware resource utilization, achieving high throughput without requiring maximum parallelism throughout.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter of adder circuit count across different stages of the decoder. By varying the number of adders from stage to stage (decreasing in each successive stage), the system optimizes the trade-off between parallel processing speed and hardware complexity, achieving log2(n) stage decoding with minimized total adder circuits compared to uniform parallel structures.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12554463B2Decoder having multiple stages of adders to decode delta encoded data
Publication Date: 2026.02.17 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US12554463B2 patent drawing
  • US12554463B2 patent drawing
  • US12554463B2 patent drawing

AI summary

Provided are a decoder unit, a decompressor unit, and method for a decoder of multiple stages of adders to decode delta encoded data. A decoder unit implemented in a cache memory having a cache memory cell array comprises a first stage of adder circuits to add, in parallel, pairs of encoded items transformed using a delta encoding, wherein the encoded items include a plurality of deltas of neighbors of sequential source items. The decoder unit further comprises at least one successive stage of adder circuits to add, in parallel in each stage, pairs of outputs from a previous stage of adder circuits, wherein each successive stage has fewer adder circuits than the previous stage, and wherein output from a last of the at least one successive stage comprises the sequential source items.