Remote Endpoint Configuration in Systolic Array Nodes

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In systolic arrays, existing systems lack the ability for a node's firmware to directly control or re-configure the endpoint hardware of remote nodes, limiting dynamic configuration and management capabilities.

Innovation Solution

A mechanism allowing a node's local firmware to control remote virtual endpoints using standard array messaging hardware and protocol, enabling remote control messages with descriptors and instructions to be sent and executed on remote nodes without requiring a local processor, thus enabling full control over remote endpoint hardware configuration and activity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If endpoint configuration is performed at system boot time by a central management entity, then configuration is simplified and consistent, but the system lacks dynamic reconfiguration capability and remote nodes cannot be controlled during operation

Engineering Contradiction:
Improvedynamic reconfiguration capabilityVSAvoidcontrol mechanism complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary mechanism where each node's firmware can generate and send control messages to remote nodes through the standard array messaging interconnect. This intermediary message-passing system enables dynamic control without requiring direct hardware access or complex point-to-point control lines between nodes.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent makes the standard array messaging hardware and protocol serve dual purposes: both for data communication between nodes and for controlling remote endpoint configuration. This multi-functionality eliminates the need for separate dedicated control interconnects, reducing overall system complexity while enabling dynamic reconfiguration.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If a node's firmware cannot directly control remote endpoint hardware, then hardware isolation and security are maintained, but dynamic configuration and remote management capabilities are limited

Engineering Contradiction:
Improveremote endpoint control capabilityVSAvoidhardware control stability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent replaces direct hardware control mechanisms with a software-based message-passing approach. Instead of requiring firmware to directly manipulate remote hardware registers through complex control circuits, the system uses standardized messages transmitted through the existing messaging interconnect, substituting mechanical/hardware control with software-mediated control.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The control messages act as intermediaries between the local firmware and remote endpoint hardware. These messages encapsulate configuration instructions and are processed by the remote node's firmware, which then applies them to the endpoint hardware. This intermediary layer maintains hardware isolation while enabling control.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If additional interconnect hardware is added to enable remote node control, then direct control capability is improved, but system complexity and resource usage increase

Engineering Contradiction:
Improveremote control capabilityVSAvoidinterconnect structure
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent makes the existing standard array messaging interconnect serve dual purposes: data communication and control/configuration. By encoding control instructions within the existing message format, the system eliminates the need for separate dedicated control interconnects, maintaining simplicity while enabling remote endpoint management.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Productivity

If processor involvement is required for remote node configuration, then configuration accuracy is improved, but operation speed and efficiency decrease

Engineering Contradiction:
Improveconfiguration speedVSAvoidconfiguration accuracy
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent extracts the configuration control functionality from the processor and implements it directly in hardware at the endpoint level. The control messages are processed and executed by hardware logic in the remote node, bypassing the processor entirely for configuration operations. This extraction enables both high-speed operation and precise hardware-level control.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11093308B2System and method for sending messages to configure remote virtual endpoints in nodes of a systolic array
Publication Date: 2021.08.17 OVH US LLC
  • US11093308B2 patent drawing

AI summary

Embodiments as disclosed herein provide for methods and systems that give firmware in a given node the ability to control the hardware configuration and activity of every endpoint in every remote node within the array. The standard, inter-node, message passing interconnect and protocol are utilized for this purpose.