Transaction Retry Regulator Circuit for IC Bandwidth Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In computing systems with multiple requester and completer nodes, backpressure issues arise when completer nodes lack resources, leading to increased retry requests and decreased system bandwidth, causing performance degradation due to idle storage resources and communication overhead.

Innovation Solution

Implementing a retry monitor and intervention level generator to regulate transaction requests by monitoring retry events and adjusting intervention levels, which control link credits allocated to requester nodes, thereby managing the flow of transactions and preventing excessive retries.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If completer nodes allocate credits for retry requests when resources are unavailable, then transaction requests can be resent later, but system bandwidth decreases due to increased retry overhead and idle storage resources

Engineering Contradiction:
Improvetransaction completionVSAvoidsystem bandwidth
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The regulator circuit performs preliminary action by controlling the delivery of link credits to requester nodes before transactions are sent. This prevents requester nodes from sending transactions when completer nodes lack resources, thereby avoiding retry requests and maintaining system bandwidth while ensuring reliable transaction completion.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The regulator circuit uses feedback from retry monitor circuits that monitor retry events between requester and completer nodes. When retry events exceed a threshold, the regulator reduces link credit delivery to prevent further bandwidth degradation, and increases it when retry events decrease, dynamically optimizing both reliability and productivity.

Inventive Principle:
Principle #23Feedback

2Productivity

If retry events are monitored and link credits are controlled to regulate transactions, then performance degradation is reduced, but device complexity increases due to additional regulator and monitor circuits

Engineering Contradiction:
Improvetransaction processing efficiencyVSAvoidregulator and monitor circuitry
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The regulator circuit performs multiple functions: it controls link credit delivery to requester nodes, regulates transaction flow based on retry events, and works with the intervention level generator to dynamically adjust intervention levels. This multi-functionality reduces the need for separate dedicated circuits for each function, thereby improving productivity while limiting the increase in device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system implements self-service through automatic regulation based on monitored retry events. The regulator circuit automatically adjusts link credit delivery without external intervention, and the intervention level generator automatically determines appropriate intervention levels based on retry event thresholds, reducing the need for complex manual control mechanisms.

Inventive Principle:
Principle #25Self-service

3Productivity

If intervention levels are dynamically adjusted based on retry events, then resource utilization is optimized, but measurement precision requirements increase for monitoring retry events

Engineering Contradiction:
Improveresource utilizationVSAvoidretry event monitoring
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system uses partial action by monitoring retry events against configurable thresholds rather than requiring precise measurement of every retry event. The regulator responds when retry events exceed thresholds, providing sufficient control for optimizing resource utilization without requiring excessive measurement precision for each individual retry event.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system changes parameters dynamically by adjusting intervention levels based on retry event thresholds. The thresholds and intervention levels are configurable parameters that can be adjusted to match different system conditions, allowing optimized resource utilization without requiring fixed high-precision measurement of retry events.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12189563B1Retry regulator for transactions of an integrated circuit
Publication Date: 2025.01.07 AMAZON TECH INC
  • US12189563B1 patent drawing
  • US12189563B1 patent drawing
  • US12189563B1 patent drawing

AI summary

Systems and methods are provided to improve system performance when multiple transaction retry events associated with transaction requests from requester nodes to completer nodes are detected. A retry monitor can monitor the transaction retry events associated with the transaction requests to provide retry information. An intervention level generator can receive information about the transaction retry events and determine an intervention level from a plurality of intervention levels based on the retry information and a retry configuration. Each requester node can be coupled to a regulator to regulate the transactions being requested by that requester node based on the intervention level and a regulator configuration, which can allow the corresponding completer nodes to complete the outstanding transactions and reduce the occurrence of retry events.