Idempotent Instruction Replay for PIM Error Protection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional error detection systems in Processing-in-Memory (PIM) systems do not provide effective error protection for idempotent operations executed at PIM devices, leading to inefficiencies in error handling and system serviceability.

Innovation Solution

The method involves issuing idempotent instructions to a PIM device and reissuing them when an error occurs within a predetermined latency period, allowing for efficient error protection and differentiation between intermittent and persistent errors by replaying instructions and maintaining them in local memory until error indications are received.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional error detection systems are used in PIM systems, then system simplicity is maintained, but error protection effectiveness for idempotent operations deteriorates

Engineering Contradiction:
Improveerror protection effectivenessVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system automatically detects errors in idempotent operations and triggers replay of the same operations without external intervention. The PIM device monitors its own execution status and requests replay when errors are detected, enabling self-service error protection that enhances reliability without requiring complex external error handling mechanisms.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system pre-identifies idempotent operations before execution and stores their results. When an error is detected, the pre-stored results can be reused or the operation can be replayed from the stored state, eliminating the need for complex error recovery procedures and reducing the impact on system complexity.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If idempotent instructions are replayed upon error detection, then error protection efficiency is improved, but instruction execution time increases

Engineering Contradiction:
Improveerror protection efficiencyVSAvoidinstruction execution time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system uses lightweight, temporary storage structures to hold idempotent operation results and replay state information. These short-living data structures enable quick error detection and replay initiation without requiring complex, long-term error handling mechanisms, thus minimizing the time overhead while maintaining effective error protection.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The system dynamically adjusts the replay decision based on error type and operation characteristics. By changing the parameter of whether to replay based on specific conditions (intermittent vs. persistent errors), the system optimizes the balance between error protection efficiency and execution time, avoiding unnecessary replays that would increase latency.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If error detection is implemented for all PIM operations, then measurement precision is improved, but system complexity increases

Engineering Contradiction:
Improveerror detection capabilityVSAvoiderror detection system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system implements error detection specifically for idempotent operations rather than all PIM operations. By applying error detection locally only where needed (for idempotent operations that can be safely replayed), the system achieves precise error detection capability for critical operations without the complexity overhead of implementing comprehensive error detection across the entire system.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The error detection system is segmented to handle only idempotent operations separately from other operations. This segmentation allows the system to implement precise error detection for the specific subset of operations that benefit from replay, while leaving other operations unaffected, thus improving error detection precision without proportionally increasing overall system complexity.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11656945B2Method and apparatus to support instruction replay for executing idempotent code in dependent processing in memory devices
Publication Date: 2023.05.23 ADVANCED MICRO DEVICES INC
  • US11656945B2 patent drawing
  • US11656945B2 patent drawing
  • US11656945B2 patent drawing

AI summary

Methods and processing devices are provided for error protection to support instruction replay for executing idempotent instructions at a processing in memory PIM device. The processing apparatus includes a PIM device configured to execute an idempotent instruction. The processing apparatus also includes a processor, in communication with the PIM device, configured to issue the idempotent instruction to the PIM device for execution at the PIM device and reissue the idempotent instruction to the PIM device when one of execution of the idempotent instruction at the PIM device results in an error and a predetermined latency period expires from when the idempotent instruction is issued.