Network-on-Chip Router Routing Based on Operating States

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In electronic devices with network-on-chip architectures, dynamic voltage and frequency scaling (DVFS) in routers and communication links leads to reduced processing speed and bandwidth, causing communication slowdowns, which is a concern for high-speed data transfer.

Innovation Solution

Implementing a system where routers in the network-on-chip dynamically adjust their operating states based on current conditions to determine optimal routes for data transmission, considering factors like power consumption, processing time, and congestion, by communicating operating state information between routers and using source or on-the-fly routing methods.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If dynamic voltage and frequency scaling is applied to routers and communication links, then power consumption is reduced, but processing speed and bandwidth are reduced causing communication slowdowns

Engineering Contradiction:
Improvepower consumptionVSAvoidprocessing speed
Core Design Contradiction:
Use of energy by moving objectVSSpeed

Solution Approach 1:

The patent implements dynamic routing that adapts to changing operating states of routers. Routers transition between different operating states (e.g., active, idle, low-power) and the routing system dynamically adjusts paths based on current states, ensuring high-speed communication when needed while allowing power savings when traffic is light.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes routing parameters (paths, next-hop selections) based on the operating states of routers. When routers are in high-performance states, traffic is routed through them; when in low-power states, alternative paths are selected, effectively changing system behavior based on parameter states without sacrificing overall performance.

Inventive Principle:
Principle #35Parameter changes

2Use of energy by moving object

If dynamic voltage and frequency scaling is applied to routers and communication links, then power consumption is reduced, but bandwidth is reduced causing communication slowdowns

Engineering Contradiction:
Improvepower consumptionVSAvoidbandwidth
Core Design Contradiction:
Use of energy by moving objectVSProductivity

Solution Approach 1:

The routing system dynamically adapts to the operational characteristics of routers at different power states. By monitoring router operating states and adjusting routing decisions in real-time, the system maintains effective bandwidth utilization even when individual routers operate at reduced power levels.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system adjusts routing parameters based on router power states and traffic conditions. When bandwidth requirements are high, the system routes traffic through routers in high-power states; when requirements are lower, it allows routing through power-saving states, dynamically balancing power consumption with bandwidth delivery.

Inventive Principle:
Principle #35Parameter changes

3Use of energy by moving object

If routers operate in lower-power operating states with reduced voltage and frequency, then power consumption is reduced, but packet routing speed becomes slower

Engineering Contradiction:
Improvepower consumptionVSAvoidrouting delay
Core Design Contradiction:
Use of energy by moving objectVSLoss of time

Solution Approach 1:

The system performs preliminary routing decisions that account for expected router operating states. By anticipating which routers will be in high-performance states based on traffic patterns and power management policies, the routing system can pre-select optimal paths that minimize delay while allowing routers to operate in power-saving modes when appropriate.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The routing system changes path selection parameters based on router power states. When time-critical traffic is detected, the system adjusts routing parameters to favor paths through high-power routers; for less time-sensitive traffic, it allows routing through low-power routers, effectively managing the time-power tradeoff.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10944693B2Routing flits in a network-on-chip based on operating states of routers
Publication Date: 2021.03.09 ADVANCED MICRO DEVICES INC
  • US10944693B2 patent drawing
  • US10944693B2 patent drawing
  • US10944693B2 patent drawing

AI summary

A system is described that includes an integrated circuit chip having a network-on-chip. The network-on-chip includes multiple routers arranged in a topology and a separate communication link coupled between each router and each of one or more neighboring routers of that router among the multiple routers in the topology. The integrated circuit chip also includes multiple nodes, each node coupled to a router of the multiple routers. When operating, a given router of the multiple routers keeps a record of operating states of some or all of the multiple routers and corresponding communication links. The given router then routes flits to destination nodes via one or more other routers of the multiple routers based at least in part on the operating states of the some or all of the multiple routers and the corresponding communication links.