Sparse Memory Mapping for GPU Tile-Based Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current graphics processing unit (GPU) architectures face inefficiencies in memory management, particularly in tile-based deferred rendering (TBDR) operations, where processing tasks are hindered by unmapped memory regions, leading to unnecessary resource utilization and potential early termination of jobs.

Innovation Solution

The implementation of memory access circuitry that provides a sparse mapping between virtual and physical memory addresses, discarding write operations to unmapped regions and inhibiting processing operations within entirely unmapped memory spaces, along with detector and control circuitry to identify and manage these regions effectively.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If a sparse memory mapping is implemented to optimize resource utilization, then resource utilization is improved, but processing operations accessing unmapped memory regions become problematic

Engineering Contradiction:
Improveresource utilizationVSAvoidprocessing operation reliability
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The system performs preliminary detection of whether a processing operation's memory region is entirely within unmapped memory before allowing execution. This advance checking prevents resource waste by blocking operations that would access unmapped memory, while still allowing operations that need mapped memory regions to execute normally.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent converts the potential harm of unmapped memory regions (which could cause crashes or undefined behavior) into a benefit by using the detection mechanism to identify and block problematic operations early. This transforms what would be a source of errors into a feature that enables more reliable resource management.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

2Use of energy by stationary object

If write operations to unmapped memory regions are discarded to save resources, then energy consumption is reduced, but data loss may occur

Engineering Contradiction:
Improveenergy consumptionVSAvoiddata loss
Core Design Contradiction:
Use of energy by stationary objectVSLoss of information

Solution Approach 1:

The system provides feedback through the detector circuitry that monitors memory access patterns and identifies when operations are attempting to access entirely unmapped memory regions. This feedback mechanism enables the control circuitry to make informed decisions about which operations to block, balancing energy savings with data preservation needs.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11934304B2Circuitry and method
Publication Date: 2024.03.19 ARM LTD
  • US11934304B2 patent drawing
  • US11934304B2 patent drawing
  • US11934304B2 patent drawing

AI summary

Circuitry comprises memory access circuitry to control memory access by mapping virtual memory addresses in a virtual memory address space to physical memory addresses in a physical memory address space, the memory access circuitry being configured to provide a sparse mapping in which a mapped subset of the virtual memory address space is mapped to physical memory while an unmapped subset of the virtual memory address space is unmapped, the memory access circuitry being configured to discard write operations to virtual memory addresses in the unmapped subset of the virtual memory address space and processing circuitry to execute program code defining a processing operation to generate processed data and to store the processed data in a memory region of the virtual memory address space applicable to that processing operation; detector circuitry to detect whether the memory region is entirely within the unmapped subset of the virtual memory address space.