Tiled IC Memory Addressing via Switch Routing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The increasing costs and performance limitations of ASICs have led to the use of FPGAs, which are more expensive and power-hungry, while lacking the performance of ASICs, and there is a need for a solution that combines the reconfigurability of FPGAs with the performance and capability of ASICs in a parallel processing environment.

Innovation Solution

A tiled integrated circuit architecture comprising multiple tiles, each with a processor and a switch for data forwarding, along with memory interface modules that access external memory using physical memory addresses and unique identifiers, enabling efficient memory access and routing across the circuit.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If FPGAs are used to achieve reconfigurability, then adaptability is improved, but performance deteriorates and power consumption increases

Engineering Contradiction:
ImprovereconfigurabilityVSAvoidperformance
Core Design Contradiction:
Adaptability or versatilityVSSpeed

Solution Approach 1:

The integrated circuit is divided into multiple tiles, each containing processors and memory interface modules. This segmentation allows different tiles to specialize in specific functions, with some tiles handling memory access while others perform computation, thereby achieving both reconfigurability and high performance through functional division.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Switches are introduced as intermediary components between processors and memory interface modules. These switches manage data routing and coordination between different tiles, enabling efficient communication and data transfer while maintaining the reconfigurable architecture's flexibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If FPGAs are used to achieve reconfigurability, then adaptability is improved, but power consumption increases

Engineering Contradiction:
ImprovereconfigurabilityVSAvoidpower consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

By segmenting the system into multiple tiles with dedicated memory interface modules, the patent enables more efficient power management. Not all tiles need to be fully active simultaneously, allowing the system to power down or idle specific tiles when not needed, thereby reducing overall power consumption while maintaining reconfigurability.

Inventive Principle:
Principle #1Segmentation

3Productivity

If multiple memory interface modules are added to access external memory, then memory access capability is improved, but device complexity increases

Engineering Contradiction:
Improvememory access capabilityVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The memory access function is segmented and distributed across multiple memory interface modules located in different tiles. Each module handles access to specific external memory, and the switches coordinate which module should respond to which memory access request. This distribution increases total memory access capability while managing complexity through modular organization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Switches serve as intermediaries that manage communication between processors and multiple memory interface modules. The switches handle address translation, data routing, and coordination between multiple memory interfaces, thereby increasing memory access capability while the switches absorb the complexity management.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS7620791B1Mapping memory in a parallel processing environment
Publication Date: 2009.11.17 MELLANOX TECHNOLOGIES LTD(IL)
  • US7620791B1 patent drawing
  • US7620791B1 patent drawing
  • US7620791B1 patent drawing

AI summary

An integrated circuit comprises a plurality of tiles. Each tile comprises a processor, and a switch including switching circuitry to forward data received over data paths from other tiles to the processor and to switches of other tiles, and to forward data received from the processor to switches of other tiles. The integrated circuit further includes a plurality of memory interface modules including circuitry to access a respective external memory, each memory interface module coupled to a switch of at least one tile. At least some of the tiles are configured to access an address in an external memory by sending from the switch a packet that includes a physical memory address that includes the external memory address and information identifying the corresponding external memory.