GPU Metadata Buffer for Reducing Memory Fetches

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Graphics Processing Units (GPUs) in mobile devices consume significant power due to frequent memory fetches from system memory for rendering tasks, particularly when dealing with color patterns and fixed color values across multiple sub-frames.

Innovation Solution

The GPU determines image data based on information stored in a metadata buffer, embedding fixed color values or pointers to similar sub-frames, allowing it to access cached image data instead of repeatedly fetching from system memory, thereby reducing the number of memory accesses.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If the GPU performs frequent fetches from system memory for rendering tasks, then the image data can be retrieved for rendering, but power consumption increases significantly

Engineering Contradiction:
Improvepower consumptionVSAvoidmemory fetch operations
Core Design Contradiction:
Use of energy by moving objectVSProductivity

Solution Approach 1:

The patent applies preliminary action by embedding fixed color values and color pattern information in metadata buffers during the encoding phase, before the GPU needs to render the frames. This allows the GPU to retrieve image data from cache without performing frequent fetches from system memory, thereby reducing power consumption while maintaining rendering productivity

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by creating a metadata buffer that contains copies of fixed color values and color pattern information. Instead of fetching the actual image data from system memory for every rendering operation, the GPU uses the copied metadata information to reconstruct or reference the needed data from cache, reducing memory access frequency and power consumption

Inventive Principle:
Principle #26Copying

2Quantity of substance

If the GPU fetches image data from system memory for each sub-frame, then complete image data is available for rendering, but memory bandwidth usage increases

Engineering Contradiction:
Improvememory bandwidth usageVSAvoidimage data availability
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent extracts only the essential information needed for rendering by separating fixed color values and color pattern information from the complete image data. This extracted metadata is stored in a dedicated buffer, allowing the GPU to retrieve only the necessary information for each sub-frame rather than fetching complete image data, thereby reducing memory bandwidth usage while ensuring reliable image data availability

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the image data into two parts: fixed color values/color patterns stored in metadata buffers and actual image content stored in frame buffers. This segmentation allows the GPU to access only the relevant segment (metadata) for determining image data, reducing overall memory bandwidth consumption while maintaining complete image data availability when needed

Inventive Principle:
Principle #1Segmentation

3Volume of stationary object

If the GPU stores complete image data for all sub-frames in system memory, then all image data is readily accessible, but memory capacity requirements increase

Engineering Contradiction:
Improvememory capacityVSAvoidimage data access
Core Design Contradiction:
Volume of stationary objectVSEase of operation

Solution Approach 1:

The patent implements the nested doll principle by embedding metadata (fixed color values and color patterns) within the frame buffer structure. The metadata buffer is nested within or alongside the frame buffer, allowing the GPU to access compact metadata information that references or contains essential image data characteristics, thereby reducing overall memory capacity requirements while maintaining ease of operation for image data access

Inventive Principle:
Principle #7Nested doll (Nesting)

Data Source

PatentUS10445902B2Fetch reduction for fixed color and pattern sub-frames
Publication Date: 2019.10.15 QUALCOMM INC
  • US10445902B2 patent drawing
  • US10445902B2 patent drawing
  • US10445902B2 patent drawing

AI summary

Techniques are described in which a device is configured to retrieve a metadata buffer for rendering a sub-frame of a set of sub-frames for a frame. A data block of a data buffer is configured to store image data for rendering the sub-frame. In response to determining, based on the metadata buffer for rendering the sub-frame, that the sub-frame includes a color pattern, fixed color value, or combination thereof, the device refrains from retrieving the image data from the data block of the data buffer and determines the image data for rendering the sub-frame based on the metadata buffer.