GPU Texture Fetch Scheduling for Bandwidth and Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing graphics processing units (GPUs) face bottlenecks in memory bandwidth and texture fetch latency, limiting computational power and efficiency in applications such as 3D games and benchmarks.

Innovation Solution

Implementing techniques to parallelize texture fetch operations with other GPU operations, increasing memory bandwidth and reducing latency by concurrent execution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If sequential texture fetch operations are used, then memory bandwidth is limited, but texture fetch latency increases

Engineering Contradiction:
Improvememory bandwidthVSAvoidtexture fetch latency
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The patent implements preliminary action by fetching textures in advance before they are needed for rendering. The system proactively loads textures into memory based on predicted future needs, allowing the GPU to execute rendering operations without waiting for texture fetch completion. This resolves the contradiction by performing the time-consuming texture fetch operation before it becomes a bottleneck, thereby increasing effective memory bandwidth utilization while reducing perceived latency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies dynamics by making the texture fetch timing adaptive rather than fixed. The system dynamically adjusts when textures are fetched based on the current rendering state, predicted future frames, and available memory resources. This dynamic approach allows the system to optimize between memory bandwidth utilization and latency reduction by loading textures at the most advantageous moments in the rendering pipeline.

Inventive Principle:
Principle #15Dynamics

2Productivity

If multiple textures are fetched concurrently, then computational efficiency increases, but memory management complexity increases

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidmemory management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the texture management system into distinct functional components: a texture loader that handles fetch operations, a renderer that processes graphics data, and a memory manager that coordinates resources. Each component operates semi-independently with well-defined interfaces, allowing concurrent texture fetching without overwhelming complexity. The segmentation enables parallel processing while maintaining manageable memory through structured organization of texture data and metadata.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements feedback mechanisms where the memory manager monitors memory usage patterns, texture access frequencies, and rendering progress. This feedback information is used to dynamically adjust texture loading strategies, prioritize which textures to load first, and manage memory capacity constraints. The feedback loop enables intelligent concurrent texture fetching that balances computational efficiency with memory management complexity.

Inventive Principle:
Principle #23Feedback

3Speed

If texture data is stored in graphics memory, then access speed improves, but memory capacity is limited

Engineering Contradiction:
Improvetexture access speedVSAvoidmemory capacity
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

The patent applies partial action by loading only the necessary portion of texture data into high-speed graphics memory rather than all possible textures. The system determines which textures are actually needed based on the current scene, camera position, and predicted future views, then loads only those specific texture regions. This selective loading maximizes the utilization of limited high-speed memory capacity while maintaining fast access speeds for the active subset of textures.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent changes the parameter of texture data organization by transforming textures from their original high-resolution format into optimized representations suitable for graphics memory. The system adjusts texture parameters such as resolution, compression format, and data precision based on the balance between access speed requirements and memory capacity constraints. This parameter transformation enables more efficient use of limited memory while maintaining acceptable performance.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20260010968A1Concurrent texture fetch using graphics memory
Publication Date: 2026.01.08 QUALCOMM INC
  • US20260010968A1 patent drawing
  • US20260010968A1 patent drawing
  • US20260010968A1 patent drawing

AI summary

Aspects presented herein relate to methods and devices for graphics processing including an apparatus, e.g., a graphics processor. The apparatus may obtain an indication of a set of graphics workloads associated with the graphics processing. The apparatus may also execute a first graphics workload in the set of graphics workloads, where the first graphics workload is associated with first data. Further, the apparatus may store, based on the execution of the first graphics workload, second data that is associated with a second graphics workload in the set of graphics workloads.