Variable-Width Differential Memory Compression for GPU Bandwidth

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional computing systems face challenges in increasing image throughput to enhance user interaction and experience, particularly with the need for improved graphics processing unit (GPU) performance in generating realistic images.

Innovation Solution

The method involves performing difference transformation and length selection, followed by packing using varying sized bit fields to produce a compressed representation, specifically applying variable-width differential memory compression to reduce GPU memory access bandwidth, applicable to image color data, depth data, and stencil data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional memory access methods are used in GPUs, then image generation can proceed, but memory bandwidth consumption is excessive and image throughput is limited

Engineering Contradiction:
Improveimage throughputVSAvoidmemory bandwidth consumption
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential difference information from image samples rather than storing complete sample data. By calculating differences between reference and current samples and storing only these differences (which are often zero or small values), the system significantly reduces memory bandwidth consumption while maintaining image generation capability

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the representation parameter of image data from storing complete sample values to storing difference values. This parameter transformation allows the system to exploit the statistical property that differences between adjacent or temporally related samples are often zero or require fewer bits to represent, thereby reducing memory bandwidth requirements

Inventive Principle:
Principle #35Parameter changes

2Productivity

If image data is compressed using fixed-size fields, then memory bandwidth is reduced, but compression efficiency is limited due to inability to adapt to actual data characteristics

Engineering Contradiction:
Improvecompression efficiencyVSAvoidbit field structure
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements dynamic bit field structures where the width of each bit field is determined by the actual difference value magnitude rather than being fixed. This allows the compression scheme to adapt to the statistical characteristics of the image data, using smaller field widths for common small differences and larger widths for rare large differences, thereby optimizing compression efficiency

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent applies different bit field widths to different difference values based on their local characteristics. Instead of using a uniform field width for all samples, the system assigns appropriate field sizes locally according to the actual difference magnitude, achieving better overall compression while maintaining simplicity in the encoding logic

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9607407B2Variable-width differential memory compression
Publication Date: 2017.03.28 NVIDIA CORP
  • US9607407B2 patent drawing
  • US9607407B2 patent drawing
  • US9607407B2 patent drawing

AI summary

A method, in one embodiment, can include performing difference transformation of image samples. In addition, the method can also include performing length selection. Furthermore; the method can include performing packing that includes utilizing varying sized bit fields to produce a compressed representation.