Graded Throttling for Network-on-Chip Traffic Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

As network-on-chip traffic increases, existing systems face performance degradation due to lack of effective traffic management, with agents having no direct knowledge of network state or capacity, leading to potential overloading.

Innovation Solution

Implementing graded throttling policies based on outstanding transactions, where agents calculate and compare transaction numbers to thresholds, dynamically adjusting traffic generation rates through light, heavy, or stop throttling policies, and recalculating to prevent oscillation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traffic generation rate is increased to improve productivity, then network throughput increases, but performance degradation occurs due to network overloading

Engineering Contradiction:
Improvenetwork throughputVSAvoidnetwork performance
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent implements a feedback mechanism where agents monitor the number of outstanding transactions in the network and adjust their traffic generation rate accordingly. When the outstanding transaction count exceeds a threshold, agents automatically throttle their traffic, creating a closed-loop control system that maintains network performance while maximizing throughput.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

Each agent in the network autonomously monitors its own outstanding transactions and self-regulates its traffic generation rate without requiring centralized control. This decentralized self-service approach allows agents to independently adapt to network conditions and prevent overloading while maintaining overall system productivity.

Inventive Principle:
Principle #25Self-service

2Ease of operation

If decentralized control is implemented to improve ease of operation, then system complexity increases due to lack of centralized coordination

Engineering Contradiction:
Improvedecentralized controlVSAvoidsystem coordination
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent changes the operational parameters of agents based on network conditions by adjusting traffic generation rates dynamically. Agents modify their behavior parameters (throttling levels) in response to outstanding transaction counts, enabling decentralized control to achieve coordinated system-wide performance without complex centralized management.

Inventive Principle:
Principle #35Parameter changes

3Stability of the object's composition

If traffic throttling is applied to prevent overloading, then network stability improves, but productivity decreases due to reduced traffic flow

Engineering Contradiction:
Improvenetwork stabilityVSAvoidtraffic flow
Core Design Contradiction:
Stability of the object's compositionVSProductivity

Solution Approach 1:

The patent implements dynamic traffic throttling where the degree of throttling adjusts continuously based on real-time network conditions. Rather than applying fixed throttling levels, agents dynamically modify their traffic generation rates in response to outstanding transaction counts, allowing the system to maintain stability while preserving maximum possible productivity under varying load conditions.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11876718B2Graded throttling for network-on-chip traffic
Publication Date: 2024.01.16 ADVANCED MICRO DEVICES INC
  • US11876718B2 patent drawing
  • US11876718B2 patent drawing
  • US11876718B2 patent drawing

AI summary

Graded throttling for network-on-chip traffic, including: calculating, by an agent of a network-on-chip, a number of outstanding transactions issued by the agent; determining that the number of outstanding transactions meets a threshold; and implementing, by the agent, in response to the number of outstanding transactions meeting the threshold, a traffic throttling policy.