Unified Memory Access Circuit Coalescing Texture and Load-Store Operations

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional graphics processors require separate circuitry for texture reads and load/store operations, leading to inefficiencies and increased circuitry usage.

Innovation Solution

Implementing a system that coalesces memory access requests from threads within a thread block into a unified memory access path, combining texture reads and load/store operations into a single sequence for efficient memory access.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If separate circuitry is provided for texture reads and load/store operations, then each operation type can be processed independently, but the overall circuitry complexity and resource usage increase

Engineering Contradiction:
Improveindependent processing capabilityVSAvoidcircuitry usage
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges separate texture read circuitry and load/store circuitry into a unified memory access circuit that can handle both operation types through a single path. This consolidation reduces overall circuitry complexity while maintaining the ability to process different operation types independently when needed, directly resolving the contradiction between independent processing capability and circuitry usage.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The unified memory access circuit is designed to perform multiple functions - it can process texture reads, load operations, and store operations through a single circuit path. This multi-functional design eliminates the need for separate dedicated circuitry for each operation type, reducing device complexity while preserving independent processing capabilities through software-controlled operation routing.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If multiple memory access requests are processed separately through different circuit paths, then each request can be handled independently, but memory access efficiency decreases

Engineering Contradiction:
Improveindependent request handlingVSAvoidmemory access efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent combines multiple memory access requests from different operation types into a single unified memory access path, enabling coalescing of requests that access the same memory location. This merging allows the system to maintain independent request handling while improving efficiency by consolidating redundant accesses, directly addressing the contradiction between independent handling and access efficiency.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system performs preliminary coalescing of memory access requests before they reach the memory interface. By identifying and merging requests for the same memory location in advance, the system prepares optimized access patterns that improve memory access efficiency while preserving the independence of original request processing through the unified circuit path.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If separate dedicated paths are used for texture operations and load/store operations, then each path can be optimized for its specific function, but overall system resource utilization increases

Engineering Contradiction:
Improvefunction-specific optimizationVSAvoidsystem resources
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent implements a universal memory access circuit that can be configured to handle different operation types (texture reads, loads, stores) through a single path. This multi-functional approach maintains function-specific optimization capabilities while reducing the total quantity of circuit resources required, as the same circuit infrastructure serves multiple purposes rather than requiring separate dedicated paths for each operation type.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9946666B2Coalescing texture access and load/store operations
Publication Date: 2018.04.17 NVIDIA CORP
  • US9946666B2 patent drawing
  • US9946666B2 patent drawing
  • US9946666B2 patent drawing

AI summary

A system, method, and computer program product are provided for coalescing memory access requests. A plurality of memory access requests is received in a thread execution order and a portion of the memory access requests are coalesced into memory order, where memory access requests included in the portion are generated by threads in a thread block. A memory operation is generated that is transmitted to a memory system, where the memory operation represents the coalesced portion of memory access requests.