Range Decoder Circuit Parallel Context Value Retrieval

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current general-purpose processors in data centers are inefficient for high-capacity network and storage workloads, particularly in processing packet streams due to their design not being optimized for such tasks.

Innovation Solution

A highly programmable data processing unit with specialized hardware-based accelerators, including a range decoder circuit, that performs context-based range decoding by retrieving context values from previous packets in parallel or before their expansion, allowing for simultaneous decoding of current packets.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If context values are retrieved after previous packets are expanded, then decoding accuracy is improved, but decoding latency increases

Engineering Contradiction:
Improvedecoding accuracyVSAvoiddecoding latency
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent implements a dual-buffer system where context values are pre-loaded into a second buffer while the first buffer is being expanded. This preliminary action allows the decoder to access context values without waiting for packet expansion to complete, thereby reducing decoding latency while maintaining accuracy. The buffers are strategically positioned and managed to ensure that context values are ready before needed for decoding operations.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If general purpose processors are used for packet stream processing, then device versatility is improved, but processing efficiency deteriorates

Engineering Contradiction:
Improvedevice versatilityVSAvoidprocessing efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent segments the processing system into distinct functional units: a dedicated hardware accelerator for context-based range decoding operations and a general-purpose processor for control and coordination. The hardware accelerator is further divided into specialized components including buffer management units, expansion circuits, and decoding logic. This segmentation allows the system to maintain versatility through the general-purpose processor while achieving high processing efficiency through specialized hardware acceleration for packet stream processing.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11188338B2Context value retrieval prior to or parallel with expansion of previous symbol for context-decoding in range decoder
Publication Date: 2021.11.30 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11188338B2 patent drawing
  • US11188338B2 patent drawing
  • US11188338B2 patent drawing

AI summary

A highly programmable device, referred to generally as a data processing unit, having multiple processing units for processing streams of information, such as network packets or storage packets, is described. The data processing unit includes one or more specialized hardware accelerators configured to perform acceleration for various data-processing functions. This disclosure describes examples of retrieving values represented by one or more previous symbols needed for decoding a current symbol before or in parallel with the insertion of the values represented by the one or more previous symbols in the data stream.