Tiled Integrated Circuit Memory Management via Switch Translation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The increasing costs and performance limitations of ASICs have led to the use of FPGAs, which are more expensive and power-hungry, while lacking the performance of ASICs, and there is a need for a solution that combines the reconfigurability of FPGAs with the performance and capability of ASICs.

Innovation Solution

A tiled integrated circuit architecture comprising multiple tiles, each with a processor and a switch that forwards data between tiles, featuring a translation lookaside buffer to translate virtual memory addresses to physical addresses, and a direct memory access engine for efficient data transfer between tiles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If FPGAs are used to achieve reconfigurability, then adaptability is improved, but performance deteriorates and power consumption increases

Engineering Contradiction:
ImprovereconfigurabilityVSAvoidperformance
Core Design Contradiction:
Adaptability or versatilityVSSpeed

Solution Approach 1:

The integrated circuit is divided into multiple tiles, each containing a processor and switch, arranged in a grid topology. This segmentation allows for reconfigurability while maintaining performance by enabling parallel processing across tiles. Each tile can be independently configured and processed, resolving the contradiction between adaptability and performance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A translation lookaside buffer (TLB) is introduced as an intermediary component to translate virtual memory addresses to physical addresses. This mediator enables efficient memory management and address translation across the tiled architecture, improving overall system performance while maintaining reconfigurability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If FPGAs are used to achieve reconfigurability, then adaptability is improved, but power consumption increases

Engineering Contradiction:
ImprovereconfigurabilityVSAvoidpower consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

By segmenting the circuit into multiple tiles with dedicated processors and switches, the architecture enables finer-grained reconfiguration. This allows only the necessary portions of the circuit to be active at any given time, reducing overall power consumption while maintaining adaptability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Each tile contains its own processor and switching circuitry that can operate independently, enabling self-service processing. This reduces the need for global reconfiguration and lowers power consumption compared to traditional FPGA approaches.

Inventive Principle:
Principle #25Self-service

3Speed

If ASICs are used to achieve performance, then speed is improved, but adaptability deteriorates

Engineering Contradiction:
ImproveperformanceVSAvoidreconfigurability
Core Design Contradiction:
SpeedVSAdaptability or versatility

Solution Approach 1:

The architecture introduces dynamic reconfigurability at the tile level, allowing the circuit to adapt its configuration based on specific applications. This dynamic aspect enables ASIC-like performance within each tile while maintaining FPGA-like adaptability at the system level.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The tiled architecture provides multi-functionality by allowing different tiles to be configured for different operations. The same basic tile structure can serve multiple purposes through reconfiguration, achieving both performance and adaptability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Adaptability or versatility

If a tiled architecture with virtual memory addresses is used, then adaptability is improved, but device complexity increases

Engineering Contradiction:
ImprovereconfigurabilityVSAvoidmemory address translation complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The translation lookaside buffer (TLB) serves as an intermediary that handles virtual to physical address translation. This mediator component simplifies the overall system by providing a dedicated mechanism for address translation, reducing the complexity burden on other parts of the system.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The TLB performs preliminary address translation before data access occurs. This preliminary action caches the translation results, avoiding repeated translation operations and reducing the effective complexity of memory address management in the tiled architecture.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS7624248B1Managing memory in a parallel processing environment
Publication Date: 2009.11.24 MELLANOX TECHNOLOGIES LTD(IL)
  • US7624248B1 patent drawing
  • US7624248B1 patent drawing
  • US7624248B1 patent drawing

AI summary

An integrated circuit comprises a plurality of tiles. Each tile comprises: a processor, a switch including switching circuitry to forward data received over data paths from other tiles to the processor and to switches of other tiles, and to forward data received from the processor to switches of other tiles, according to a switch instruction indicating an input port to which each of multiple output ports of the switch is to be coupled, and a translation lookaside buffer coupled to the switch to translate virtual memory addresses of switch instructions to physical memory addresses of the switch instructions.