GPU Memory Controller ECC Switching for Bandwidth Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing graphics processing units (GPUs) face performance degradation due to the need for error checking and correction (ECC) in general-purpose computing applications, which is not necessary for 3D gaming applications, leading to inefficiencies in memory bandwidth usage.

Innovation Solution

A GPU system with a memory controller that can dynamically switch between ECC and non-ECC memory access modes based on the type of application being run, allowing ECC to be enabled for general-purpose computing and disabled for 3D gaming to optimize memory bandwidth.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If ECC memory access mode is used for general-purpose computing applications, then data reliability is improved, but memory bandwidth and processing speed deteriorate

Engineering Contradiction:
Improvedata reliabilityVSAvoidmemory bandwidth
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent implements dynamic switching between ECC and non-ECC memory access modes based on the running application type. The system detects whether a 3D gaming or general-purpose computing application is active and automatically configures the memory controller to use the appropriate mode, making the system adaptable rather than static.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent applies different memory access qualities to different application types: ECC mode is applied locally to general-purpose computing applications that require data reliability, while non-ECC mode is applied to 3D gaming applications where speed is prioritized. This localized application of quality ensures each application receives the appropriate level of error checking.

Inventive Principle:
Principle #3Local quality

2Reliability

If ECC is always enabled in GPU memory controller, then data integrity is improved for computing applications, but performance is degraded for 3D gaming applications

Engineering Contradiction:
Improvedata integrityVSAvoidprocessing speed
Core Design Contradiction:
ReliabilityVSSpeed

Solution Approach 1:

The memory controller dynamically adjusts its operation mode based on real-time detection of the running application. When a general-purpose computing application is detected, ECC mode is activated to ensure data integrity. When a 3D gaming application is detected, the system switches to non-ECC mode to maximize processing speed.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the operational parameters of the memory controller based on application type. The error checking parameter is enabled for computing applications and disabled for gaming applications, allowing the system to optimize between data integrity and processing speed by modifying the ECC parameter state.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If ECC mode is used for 3D gaming applications, then data reliability is improved, but memory bandwidth efficiency deteriorates

Engineering Contradiction:
Improvedata reliabilityVSAvoidmemory bandwidth efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent extracts the ECC error checking function from the default always-on state and selectively applies it only when needed. By taking out the ECC overhead from the 3D gaming execution path, the system eliminates unnecessary processing steps that would reduce memory bandwidth efficiency, while preserving the capability to enable ECC when running computing applications.

Inventive Principle:
Principle #2Taking out (Extraction)

4Adaptability or versatility

If the system reconfigures memory access modes, then adaptability to different applications is improved, but system complexity increases

Engineering Contradiction:
Improveapplication-dependent configurationVSAvoidmemory controller complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system implements self-service through automatic detection and configuration. The memory controller monitors the running application type and autonomously switches between ECC and non-ECC modes without requiring manual user intervention or complex external control logic, thereby reducing the perceived system complexity while maintaining high adaptability.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS8692836B2Computer system and processing method utilizing graphics processing unit with ECC and non-ECC memory switching capability
Publication Date: 2014.04.08 KIOXIA CORP
  • US8692836B2 patent drawing
  • US8692836B2 patent drawing

AI summary

Computer systems and methods that utilize a GPU whose operation is able to switch between ECC and non-ECC memory operations on demand. The computer system includes a graphics processing unit and a memory controller and local memory that are functionally integrated with the graphics processing unit. The memory controller has at least two operating modes comprising a first memory access mode that uses error checking and correction when accessing the local memory, and a second memory access mode that does not use error checking and correction when accessing the local memory. The memory controller is further operable to switch the operation of the memory controller between the first and second memory access modes without rebooting the computer system.