Adaptive Multiplier Array Reconfiguration for Variable Dot Products
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing hardware systems with fixed multiplier arrays are inefficient in performing different dot products and matrix multiplications, as they are inflexible and cannot adapt to varying sizes or precision requirements, leading to suboptimal use of hardware resources in applications like machine learning and RF simulations.
Innovation Solution
An integrated circuit with a data selection circuit that enables reconfiguration of an adaptive multiplier array to perform different dot products by altering data transmission, allowing the same hardware to execute various dot products of different lengths and precision levels, thereby optimizing hardware usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If fixed multiplier arrays are used in hardware systems, then the hardware structure is simple and reliable, but the adaptability to different dot product sizes and precision requirements is poor
Solution Approach 1:
The patent implements dynamic reconfiguration of the multiplier array by introducing control logic that can change the operational mode of the array based on the required dot product size. The same physical hardware can be dynamically reconfigured to perform different configurations (e.g., 4x4, 8x8, 16x16 dot products) by adjusting control signals that enable or disable specific multipliers and accumulate rs, providing adaptability without requiring multiple fixed arrays
Solution Approach 2:
The patent creates a universal multiplier array that can perform multiple functions by configuring the same hardware resources to handle different dot product sizes and precision requirements. The control logic enables the array to universally support various operations (different N×N dot products) through software-configurable parameters, eliminating the need for separate dedicated hardware for each operation type
2Productivity
If specialized circuitry is designed for a fixed dot product, then the compute efficiency for that specific operation is high, but the productivity for varying operations decreases
Solution Approach 1:
The patent prepares the multiplier array for reconfiguration by pre-organizing the control logic and data paths so that switching between different dot product configurations can be achieved quickly. The control signals and enabling mechanisms are designed in advance to allow rapid transitions between operational modes without requiring complex reconfiguration sequences, minimizing the time lost during mode switching
3Adaptability or versatility
If the hardware performs a fixed dot product, then the manufacturing precision and reliability are maintained, but the adaptability to different precision requirements is lost
Solution Approach 1:
The patent changes operational parameters (such as the number of active multipliers, accumulate rs, and data path widths) to adapt to different precision requirements while maintaining computational reliability. By dynamically adjusting which hardware resources are activated and how data flows through the system, the same reliable hardware can accurately perform both low-precision and high-precision dot products appropriate to the configured mode
Data Source
AI summary
Examples herein describe techniques for adapting a multiplier array (e.g., a systolic array implemented in a processing core) to perform different dot products. The processing core can include data selection logic that enables different configurations of the multiplier array in the core. For example, the data selection logic can enable different configurations of the multiplier array while using the same underlying hardware. That is, the multiplier array is fixed hardware but the data selection can transmit data into the matrix multiplier such that it is configured to perform different length dot products, perform more dot products in parallel, or change its output precision. In this manner, the same underlying hardware (i.e., the multiplier array) can be reconfigured for different dot products which can result in much more efficient use of the hardware.