Runtime Function Execution Across Reconfigurable Processors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The configuration and execution of reconfigurable processors are hindered by complex and time-consuming procedures for distributing and loading configuration files, which impede efficient operation and inter-node processing.

Innovation Solution

The implementation of buffer-based streaming systems that facilitate efficient data transfer between reconfigurable processors on the same node and different nodes, utilizing host and interface buffers, and reconfigurable processor buffers to optimize latency and streamline configuration file execution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If configuration files are distributed and loaded using traditional procedures, then reconfigurable processors can be configured and executed, but the process becomes complex and time-consuming, impeding efficient operation and inter-node processing

Engineering Contradiction:
Improveconfiguration file distribution efficiencyVSAvoidconfiguration loading time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system divides configuration data into multiple segments that can be distributed across different buffers (host buffers, interface buffers, reconfigurable processor buffers) and loaded in parallel. This segmentation allows simultaneous configuration of multiple reconfigurable processors across different nodes, significantly reducing total configuration time and improving distribution efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Configuration files are pre-processed and staged in host buffers before actual distribution to reconfigurable processors. This preliminary action prepares configuration data in advance, allowing faster loading and reducing the critical path time for configuration operations across processing nodes.

Inventive Principle:
Principle #10Preliminary action

2Speed

If buffer-based streaming systems are implemented to enable efficient data transfer, then latency is reduced and configuration file distribution is streamlined, but system complexity increases due to multiple buffer types and inter-node coordination

Engineering Contradiction:
Improvedata transfer speedVSAvoidbuffer system complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The buffer system is designed with universal interfaces and standardized data formats that allow the same buffer architecture to handle multiple types of data transfers (configuration files, computation data, inter-node communication). This multi-functionality reduces the need for specialized buffer circuits for each operation type, managing complexity while maintaining high transfer speeds.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

Interface buffers serve as intermediary structures between host buffers and reconfigurable processor buffers, providing a standardized interface layer that simplifies the complexity of direct point-to-point connections. This intermediary approach manages the complexity of inter-node coordination while enabling efficient data transfer through buffered streaming.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If rapid configuration file distribution is achieved through buffer-based streaming, then execution efficiency across multiple processing nodes is improved, but the complexity of coordinating inter-node operations increases

Engineering Contradiction:
Improveexecution efficiencyVSAvoidinter-node coordination complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system merges configuration distribution and execution initiation into a unified buffer-based streaming process. Configuration files are distributed and executed across multiple processing nodes through a coordinated buffer system that combines data transfer and execution control, improving overall execution efficiency while managing coordination complexity through integration rather than separate processes.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The buffer system employs dynamic allocation and coordination mechanisms that adapt to the specific requirements of different inter-node operations. Buffer sizes, data flow rates, and coordination protocols are dynamically adjusted based on workload characteristics, enabling efficient execution across multiple nodes while managing coordination complexity through adaptive control rather than rigid predetermined structures.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11886930B2Runtime execution of functions across reconfigurable processor
Publication Date: 2024.01.30 SAMBANOVA SYSTEMS INC
  • US11886930B2 patent drawing
  • US11886930B2 patent drawing
  • US11886930B2 patent drawing

AI summary

The technology disclosed relates to runtime execution of functions across reconfigurable processor. In particular, the technology disclosed relates to a runtime logic that is configured to execute a first set of functions in a plurality of functions and/or data therefor on a first reconfigurable processor, and a second set of functions in the plurality of functions and/or data therefor on additional reconfigurable processors. Functions in the second set of functions and/or the data therefor are transmitted to the additional reconfigurable processors using one or more of a first reconfigurable processor-to-additional reconfigurable processors buffers, and results of executing the functions and/or the data therefor on the additional reconfigurable processors are transmitted to the first reconfigurable processor using one or more of additional reconfigurable processors-to-first reconfigurable processor buffers.