P2P Route-Through in Reconfigurable Dataflow Units

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems for inter-die communication in reconfigurable processors require additional hardware for switching fabrics, which can be costly and inefficient, especially when direct connections between Reconfigurable Dataflow Units (RDUs) are overloaded or non-existent.

Innovation Solution

Implementing a peer-to-peer (P2P) route-through capability that allows P2P messages to be sent to an intermediate RDU, which acts as a switching fabric to route the message to the proper target RDU without the need for external components.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If additional hardware for switching fabrics is used for inter-die communication, then routing capability is improved, but device complexity and cost increase

Engineering Contradiction:
Improverouting capabilityVSAvoidhardware complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements self-service by enabling RDUs to perform routing decisions autonomously using their local pass-through tables. Each RDU independently determines whether to forward packets through itself or directly to the destination, eliminating the need for external switching fabric hardware while maintaining full routing capability.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent applies multi-functionality by enabling RDUs to serve dual purposes: both as destination nodes for P2P communication and as intermediate routing nodes. The same RDU infrastructure (interface circuits, pass-through tables, intra-RDU networks) handles both direct communication and routing functions, eliminating dedicated switching hardware.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Speed

If direct connections between RDUs are used, then communication speed is improved, but network resilience deteriorates when connections are overloaded or non-existent

Engineering Contradiction:
Improvecommunication speedVSAvoidnetwork resilience
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The patent implements dynamics by enabling the communication path to change based on real-time conditions. RDUs can dynamically select between direct connections and route-through paths based on load, availability, and configuration. The pass-through tables can be programmed to adapt routing decisions to current network state, providing both speed and resilience.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent uses intermediate RDUs as mediators when direct connections are unavailable or overloaded. Instead of requiring direct point-to-point links, an intermediate RDU with P2P route-through capability can forward messages between source and destination, maintaining communication reliability through the intermediary path.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Device complexity

If P2P route-through capability is implemented using existing RDU infrastructure, then device complexity is reduced, but bandwidth capacity may be limited by shared resources

Engineering Contradiction:
Improvehardware complexityVSAvoidbandwidth capacity
Core Design Contradiction:
Device complexityVSQuantity of substance

Solution Approach 1:

The patent applies segmentation by dividing the RDU infrastructure into separate functional components: interface circuits for external communication, pass-through tables for routing decisions, and intra-RDU networks for data transport. This segmentation allows independent optimization of each component's capacity and enables better resource management to maximize bandwidth utilization.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20250199985A1Peer-to-peer route through in a reconfigurable computing system
Publication Date: 2025.06.19 SAMBANOVA SYSTEMS INC
  • US20250199985A1 patent drawing
  • US20250199985A1 patent drawing
  • US20250199985A1 patent drawing

AI summary

A reconfigurable dataflow unit (RDU) includes an intra-RDU network, an array of configurable units connected by an array level network and function interfaces. The RDU also includes interface circuits coupled between the intra-RDU network and external interconnects. An interface circuit receives a packet from the external interconnect and extracts a target RDU identifier and compares the target RDU identifier to the value of the identity register. It also communicates over the intra-RDU network to a function interface based on information in the first packet in response to the target RDU identifier being equal to the identity register. The interface circuit retrieves another interface circuit identifier for the target RDU identifier from the pass-through table and, in response to the target RDU identifier not being equal to the identity register, sends the target RDU identifier and other information to the other interface circuit over the intra-RDU network.