Multi-Stage Network Routing via 3D Stacked VLSI Layouts

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing VLSI layouts of multi-stage interconnection networks like Benes and butterfly fat tree networks are inefficient, leading to large area requirements, increased power consumption, and longer signal latency, making them impractical for implementation on semiconductor chips.

Innovation Solution

Optimized multi-stage networks with VLSI layouts using horizontal and vertical links in a two-dimensional grid arrangement, employing shuffle exchange links and exploiting spatial locality to reduce crosspoints, area, power consumption, and latency, while maintaining high routability for broadcast, unicast, and multicast connections.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional multi-stage interconnection networks (Benes, butterfly fat tree) are implemented with conventional VLSI layouts, then routing capability is maintained, but area requirement increases significantly

Engineering Contradiction:
Improverouting capabilityVSAvoidarea requirement
Core Design Contradiction:
Adaptability or versatilityVSArea of stationary object

Solution Approach 1:

The patent transforms the traditional two-dimensional grid layout into a three-dimensional stacked architecture where switching elements are distributed across multiple layers. This vertical dimensionality change allows routing paths to extend through multiple layers, significantly reducing the horizontal area footprint while maintaining full routing capability between any input-output pairs.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent implements a hierarchical nesting structure where smaller routing networks are embedded within larger ones, and switching elements are nested across multiple scaling factors. This nested organization allows the network to maintain routing flexibility while compactly packing switching elements into a reduced area through self-similar patterns at different scales.

Inventive Principle:
Principle #7Nested doll (Nesting)

2Reliability

If conventional VLSI layouts are used for multi-stage networks, then network functionality is preserved, but power consumption increases

Engineering Contradiction:
Improvenetwork functionalityVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by stationary object

Solution Approach 1:

By distributing switching elements across multiple vertical layers, the patent reduces the horizontal distance signals must travel. This shortens wire lengths and reduces capacitive loading, directly lowering dynamic power consumption while maintaining network functionality through multi-layer signal routing paths.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent segments the monolithic network into modular switching elements distributed across multiple layers. This segmentation allows for localized signal routing within each layer, reducing long-distance signal paths and their associated power consumption, while maintaining overall network functionality through inter-layer connections.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If traditional multi-stage network layouts are implemented, then routing paths are available, but signal latency increases

Engineering Contradiction:
Improverouting path availabilityVSAvoidsignal latency
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent introduces vertical routing paths through multiple layers, creating additional dimensional freedom for signal propagation. This allows signals to bypass congested horizontal paths and take optimized three-dimensional routes, reducing the number of switching stages traversed and thereby decreasing signal latency while maintaining routing flexibility.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent pre-establishes multiple parallel routing paths across different layers during network configuration. This preliminary path setup allows signals to be routed through optimal paths before congestion occurs, minimizing traversal distance and reducing signal latency while preserving routing adaptability for dynamic traffic patterns.

Inventive Principle:
Principle #10Preliminary action

4Device complexity

If conventional layouts are used, then network structure is simple, but crosspoint count increases leading to resource inefficiency

Engineering Contradiction:
Improvenetwork structure simplicityVSAvoidcrosspoint count
Core Design Contradiction:
Device complexityVSQuantity of substance

Solution Approach 1:

By organizing switching elements in a three-dimensional stacked architecture, the patent reduces the number of crosspoints required per switching element. The vertical layering allows for more efficient connection patterns between inputs and outputs, decreasing the total crosspoint count and improving resource utilization while maintaining structural regularity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent designs universal switching elements that can be replicated and scaled across multiple layers with different scaling factors. These multi-functional blocks can serve multiple routing purposes simultaneously, reducing the total number of crosspoints needed compared to traditional designs that require dedicated crosspoints for each routing function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11777872B1Optimization of multi-stage hierarchical networks for practical routing applications
Publication Date: 2023.10.03 KONDA TECHNOLOGIES INC
  • US11777872B1 patent drawing
  • US11777872B1 patent drawing
  • US11777872B1 patent drawing

AI summary

Significantly optimized multi-stage networks, useful in wide target applications, with VLSI layouts using only horizontal and vertical links to route large scale sub-integrated circuit blocks having inlet and outlet links, and laid out in an integrated circuit device in a two-dimensional grid arrangement of blocks are presented. The optimized multi-stage networks in each block employ several rings of stages of switches with inlet and outlet links of sub-integrated circuit blocks connecting to rings from either left-hand side only, or from right-hand side only, or from both left-hand side and right-hand side; and employ shuffle exchange links where outlet links of cross links from switches in a stage of a ring in one sub-integrated circuit block are connected to either inlet links of switches in the another stage of a ring in the same or another sub-integrated circuit block.