Tiled Switch Matrix Layout for Multi-Pattern Data Permutation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data processing circuits are limited in their ability to perform a wide range of data pattern permutations, making them inadequate for dynamic systems that require multiple permutations, such as artificial intelligence processors.

Innovation Solution

A switch matrix circuit with a data permutation circuit comprising multiple adjacent switching blocks and switching stages that span across blocks, allowing data to be rearranged based on specific switch control settings, enabling the transformation of input data into various output patterns.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If custom circuits are used to perform limited data permutations, then the circuit complexity is reduced, but the adaptability to different data patterns is limited

Engineering Contradiction:
Improvedata pattern permutation capabilityVSAvoidcircuit structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The switch matrix circuit is designed to perform multiple different data pattern permutations using a single unified structure. The circuit can transform input data into various output patterns (transpose, inverse transpose, row-major to column-major, etc.) by changing control signals, eliminating the need for multiple custom circuits for different permutation types.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The circuit employs dynamically controllable switching elements that can change their connection states based on control signals. The switch control settings received in the adjacent switching blocks along the second axis enable the circuit to adapt its permutation behavior dynamically, allowing a single circuit to perform multiple permutation functions.

Inventive Principle:
Principle #15Dynamics

2Productivity

If a fixed permutation circuit is used, then the device complexity is reduced, but the productivity for dynamic systems requiring multiple permutations decreases

Engineering Contradiction:
Improvedata processing throughputVSAvoidswitching block configuration
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The permutation circuit is divided into multiple adjacent switching blocks arranged in a grid pattern, with each block containing switching stages. This segmented structure allows independent control of different regions, enabling complex permutations to be achieved through coordinated operation of simpler block-level switching stages.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The circuit uses a two-dimensional arrangement of switching blocks with data flowing along one axis and control settings applied along another axis. This dimensional separation allows the circuit to achieve multiple permutation functions by varying control settings without increasing the physical scale of the circuit.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Adaptability or versatility

If additional control logic is added to enable multiple permutations, then the adaptability improves, but the device complexity increases

Engineering Contradiction:
Improvepermutation type varietyVSAvoidcontrol logic structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The switch matrix circuit performs permutation operations using its inherent switching capability without requiring external control logic. The control settings are applied directly to the switching blocks, which self-configure to achieve the desired permutation pattern, eliminating the need for separate control logic units.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11307827B2Tiled switch matrix data permutation circuit
Publication Date: 2022.04.19 GROQ INC
  • US11307827B2 patent drawing
  • US11307827B2 patent drawing
  • US11307827B2 patent drawing

AI summary

Embodiments of the present disclosure pertain to switch matrix circuit including a data permutation circuit. In one embodiment, the switch matrix comprises a plurality of adjacent switching blocks configured along a first axis, wherein the plurality of adjacent switching blocks each receive data and switch control settings along a second axis. The switch matrix includes a permutation circuit comprising, in each switching block, a plurality of switching stages spanning a plurality of adjacent switching blocks and at least one switching stage that does not span to adjacent switching blocks. The permutation circuit receives data in a first pattern and outputs the data in a second pattern. The data permutation performed by the switching stages is based on the particular switch control settings received in the adjacent switching blocks along the second axis.