APD Memory Error Handling via Selective Halt Interrupts

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Highly parallel computing hardware, such as accelerated processing devices, face challenges in effectively handling memory errors, particularly initial uncorrectable errors that can lead to fatal errors, requiring efficient mechanisms to halt operations and propagate error information without causing unnecessary system halts.

Innovation Solution

The implementation of error units within memory units that detect errors using techniques like parity protection and error correcting codes, triggering initial uncorrectable error interrupts and halt interrupts to manage errors, ensuring that operations are halted only when critical data is consumed, and propagating error information to facilitate recovery.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If memory error detection and interruption mechanisms are implemented, then system reliability is improved, but device complexity increases

Engineering Contradiction:
Improvememory error handlingVSAvoiderror detection system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent divides the error handling system into distinct components: error detection units within memory units, error status registers, and interrupt generation mechanisms. Each memory unit has its own error detection capability, allowing localized error handling without affecting the entire system, thus improving reliability while managing complexity through modular design.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces error status registers as intermediary components between the memory units and the central processing unit. These registers store error information and trigger interrupts, acting as a buffer that simplifies the interaction between complex memory error detection systems and the CPU, thereby improving reliability without proportionally increasing overall system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If operations are halted immediately upon error detection, then system integrity is maintained, but productivity decreases

Engineering Contradiction:
Improvesystem integrityVSAvoidprocessing continuity
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent implements selective error handling where only the specific memory unit or processing element that detected an error halts its operations, while other parts of the system continue to function. This localized approach maintains system integrity by isolating errors to affected components only, thereby preserving overall productivity through continued operation of unaffected system portions.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent employs dynamic error response mechanisms where the system adapts its response based on the nature and location of the error. Rather than uniform system-wide halts, the system dynamically determines which components should halt and which should continue operating, optimizing the balance between maintaining integrity and preserving productivity through flexible, context-dependent error handling.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If comprehensive error propagation mechanisms are implemented, then measurement precision of error location is improved, but device complexity increases

Engineering Contradiction:
Improveerror location identificationVSAvoiderror propagation system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent implements a nested error tracking structure where error status registers are embedded within memory units, which are in turn part of larger memory systems. This nested organization allows precise error location identification at multiple hierarchical levels without requiring a completely separate complex error propagation system for each level, thus improving measurement precision while managing complexity through hierarchical nesting.

Inventive Principle:
Principle #7Nested doll (Nesting)

Data Source

PatentUS10372522B2Memory protection in highly parallel computing hardware
Publication Date: 2019.08.06 ADVANCED MICRO DEVICES INC
  • US10372522B2 patent drawing
  • US10372522B2 patent drawing
  • US10372522B2 patent drawing

AI summary

Techniques for handling memory errors are disclosed. Various memory units of an accelerated processing device (“APD”) include error units for detecting errors in data stored in the memory (e.g., using parity protection or error correcting code). Upon detecting an error considered to be an “initial uncorrectable error,” the error unit triggers transmission of an initial uncorrectable error interrupt (“IUE interrupt”) to a processor. This IUE interrupt includes information identifying the specific memory unit in which the error occurred (and possible other information about the error). A halt interrupt is generated and transmitted to the processor in response to the data having the error being consumed (i.e., used by an operation such as an instruction or command), which causes the APD to halt operations. If the data having the error is not consumed, then the halt interrupt is never generated (that the error occurred may remain logged, however).