Hybrid Router Switching Logic for Multicore Energy-Delay Optimization

Solution Overview

Problem

Multicore architectures face challenges in efficiently routing data between processor cores and caches due to the trade-offs between packet switching, which minimizes latency but consumes more energy, and circuit switching, which conserves energy but increases latency, without a clear method to optimize energy-delay performance.

Innovation Solution

Implementing hybrid routers within multicore architectures that include switching logic capable of selecting between packet switching and circuit switching channels based on routing objectives such as energy efficiency, latency, or their product, using a pre-fetcher and cache controller to determine the optimal fetching size and switching channel for data transfer.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If packet switching is used to route data, then latency is minimized, but energy consumption increases

Engineering Contradiction:

ImprovelatencyVSAvoidenergy consumption

Core Design Contradiction:

Loss of timeVSUse of energy by moving object

Solution Approach 1:

The router dynamically selects between packet switching and circuit switching modes based on real-time routing objectives such as energy efficiency, latency, or their product. This dynamic adaptation allows the system to optimize performance metrics by switching between different data transfer mechanisms rather than being locked into a single mode.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system changes the switching mode parameter (packet vs. circuit switching) based on routing objectives. By adjusting this parameter according to whether energy efficiency, latency, or energy-delay product is the primary concern, the router can achieve optimal performance for different workload characteristics and application requirements.

Inventive Principle:

Principle #35Parameter changes

2Use of energy by moving object

If circuit switching is used to route data, then energy consumption is reduced, but latency increases

Engineering Contradiction:

Improveenergy consumptionVSAvoidlatency

Core Design Contradiction:

Use of energy by moving objectVSLoss of time

Solution Approach 1:

The router dynamically selects between packet switching and circuit switching modes based on real-time routing objectives such as energy efficiency, latency, or their product. This dynamic adaptation allows the system to optimize performance metrics by switching between different data transfer mechanisms rather than being locked into a single mode.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system changes the switching mode parameter (packet vs. circuit switching) based on routing objectives. By adjusting this parameter according to whether energy efficiency, latency, or energy-delay product is the primary concern, the router can achieve optimal performance for different workload characteristics and application requirements.

Inventive Principle:

Principle #35Parameter changes

3Productivity

If hybrid routers with dynamic selection are implemented, then energy-delay performance is optimized, but device complexity increases

Engineering Contradiction:

Improveenergy-delay performanceVSAvoiddevice complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The router is designed with multi-functionality, incorporating both packet switching and circuit switching capabilities within a single device. The switching logic can select between these different modes based on routing objectives, making the router universally applicable to various performance requirements without requiring separate specialized routers.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

Switching logic acts as an intermediary component that mediates between the packet switching channel and circuit switching channel. This intermediary evaluates routing objectives and selects the appropriate switching mode, managing the complexity internally while presenting a unified interface to the rest of the system.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS9473426B2Hybrid routers in multicore architectures

Publication Date: 2016.10.18 MERCURY KINGDOM ASSETS LIMITED

AI summary

Technologies are generally described for methods and systems effective to implement hybrid routers in multicore architectures. A first tile may include a processor core, a cache configured to be in communication with the processor core and a router configured to be in communication with the cache. The router may be effective to move data with a packet switching channel or a circuit switching channel. The first tile may include switching logic configured to be in communication with the cache and the router. The switching logic may be effective to receive a routing objective that may relate to energy or delay costs in routing data through the network. The switching logic may select one of the packet switching channel or the circuit switching channel to move the data through the network based on the routing objective.