Intermediate Data Compression for Guaranteed GPU Memory Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current data compression methods in graphics processing units (GPUs) face challenges in reducing memory bandwidth and storage space efficiently, particularly in mobile devices, due to varying compression ratios and the need for random access to compressed data, which can lead to inefficiencies in memory allocation and power consumption.

Innovation Solution

The implementation of a data compression and decompression unit that uses a combination of lossless and lossy compression techniques, including truncation, bit replication, and adjustment values, to ensure a guaranteed compression threshold is met, allowing for efficient mapping of n-bit numbers to m-bit numbers, thereby reducing memory bandwidth and storage requirements while maintaining random access capabilities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If data compression is applied to reduce memory bandwidth and storage space, then memory bandwidth and storage requirements are reduced, but compression ratio variability and random access inefficiencies occur

Engineering Contradiction:
Improvememory bandwidthVSAvoidcompression ratio consistency
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The patent segments the compression process into multiple independent stages: a lossy compression stage that provides guaranteed compression ratio, and a lossless compression stage that achieves additional compression. This segmentation allows each stage to have deterministic behavior, ensuring consistent overall compression ratio while maintaining the ability to meet memory bandwidth requirements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The lossy compression stage is applied first as a preliminary action to reduce data size with a guaranteed compression ratio threshold. This preliminary compression creates a smaller intermediate dataset that then undergoes lossless compression, ensuring that the final compression ratio meets the required threshold while maximizing overall compression efficiency.

Inventive Principle:
Principle #10Preliminary action

2Quantity of substance

If data compression is applied to reduce storage space, then storage requirements are reduced, but random access capabilities deteriorate

Engineering Contradiction:
Improvestorage spaceVSAvoidrandom access capability
Core Design Contradiction:
Quantity of substanceVSEase of operation

Solution Approach 1:

The patent segments compressed data into multiple blocks with headers that contain metadata about the compressed content. This segmentation enables random access to specific blocks without decompressing the entire dataset, maintaining random access capability while achieving significant storage space reduction through the combined lossy and lossless compression approach.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If higher quality rendering algorithms are used on faster GPUs, then rendering quality is improved, but memory bandwidth consumption increases

Engineering Contradiction:
Improverendering qualityVSAvoidmemory bandwidth
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent changes the precision parameters of stored data by applying lossy compression that reduces bit depth while maintaining visual quality within acceptable thresholds. This parameter change allows high-quality rendering algorithms to operate with reduced memory bandwidth requirements, as the compressed data occupies less memory space and requires fewer memory transfers.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11716094B2Guaranteed data compression using intermediate compressed data
Publication Date: 2023.08.01 IMAGINATION TECH LTD
  • US11716094B2 patent drawing
  • US11716094B2 patent drawing
  • US11716094B2 patent drawing

AI summary

Methods for converting an n-bit number into an m-bit number for situations where n>m and also for situations where n<m, where n and m are integers. The methods use truncation or bit replication followed by the calculation of an adjustment value which is applied to the replicated number.