Tile Switch Architecture for Parallel Data Transfer and Lower Power

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing integrated circuits face challenges in efficiently processing large instruction streams and managing power consumption in parallel processing environments, with FPGAs being more expensive and power-hungry compared to ASICs, while lacking the performance of ASICs.

Innovation Solution

A tiled integrated circuit architecture featuring multiple tiles with processors and switches that operate independently, allowing for efficient data transfer and asynchronous clocking of tile sets, along with operand decoupling and reconfigurable logic to optimize instruction processing and reduce power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If FPGAs are used to provide reconfigurability, then adaptability is improved, but power consumption increases and performance deteriorates compared to ASICs

Engineering Contradiction:
ImprovereconfigurabilityVSAvoidpower consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The system is divided into multiple independent tiles, each with its own processor and switch memory. This segmentation allows individual tiles to be powered down when not needed, reducing overall power consumption while maintaining reconfigurability through the modular architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The switch memory dynamically extracts and processes instruction streams for different output ports independently. This dynamic operation allows the system to adapt instruction processing to actual needs, improving performance while reducing unnecessary power consumption compared to static FPGA configurations.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If FPGAs are used to provide reconfigurability, then adaptability is improved, but processing performance deteriorates compared to ASICs

Engineering Contradiction:
ImprovereconfigurabilityVSAvoidprocessing performance
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

By dividing the system into multiple tiles with dedicated processors and switch memories, each tile can process instructions independently and in parallel. This segmentation enables ASIC-like performance within each tile while the overall system maintains FPGA-like reconfigurability through the modular tile architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The independent program counters and dynamic instruction stream extraction enable each tile to operate autonomously at high speed. This dynamic parallel processing achieves ASIC-level performance while the reconfigurable tile structure maintains adaptability.

Inventive Principle:
Principle #15Dynamics

3Productivity

If independent instruction streams are processed for each output port, then processing efficiency is improved, but device complexity increases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidarchitecture complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The switch memory is divided into multiple independent output port units, each with its own program counter and instruction stream processing capability. This segmentation enables parallel processing of instruction streams for different output ports, improving efficiency while the modular design keeps each unit relatively simple.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Each output port unit is designed as a universal module that can handle different instruction streams independently. This multi-functionality allows the same hardware structure to be reused across multiple output ports, improving processing efficiency without proportionally increasing overall complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10747712B1Transferring data in a parallel processing environment
Publication Date: 2020.08.18 MASSACHUSETTS INST OF TECH
  • US10747712B1 patent drawing
  • US10747712B1 patent drawing
  • US10747712B1 patent drawing

AI summary

An integrated circuit includes a plurality of tiles. Each tile includes a processor, a switch including switching circuitry to forward data over data paths from other tiles to the processor and to switches of other tiles, and a switch memory that stores instruction streams that are able to operate independently for respective output ports of the switch.