Analog Vector-Matrix MAC Architecture With Dynamic Multi-Precision

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional multiplier-accumulator (MAC) designs require extensive processing resources and energy, with limited scalability and precision, as they perform vector-matrix multiplication operations in a single stage and lack dynamic adjustment of bit processing and throughput.

Innovation Solution

A scalable, multi-precision, self-calibrated MAC system that converts digital input vectors into analog signals, performs multiplication in the analog domain, and generates binary partial output vectors, allowing dynamic adjustment of bit processing and throughput by using one-bit digital-to-analog converters and pipelined analog-to-digital converters for efficient binary summation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If conventional analog MAC designs are used to perform vector-matrix multiplication, then the operation can be completed in a single stage, but the number of clock cycles required is large and the processing speed is slow

Engineering Contradiction:
Improveprocessing speedVSAvoidnumber of clock cycles
Core Design Contradiction:
SpeedVSDuration of action of moving object

Solution Approach 1:

The patent segments the multiplication operation into bit-order processing stages, where each stage handles one bit of the input vector. This segmentation allows parallel processing of multiple bits simultaneously, reducing the total number of clock cycles required compared to sequential single-stage analog MAC designs.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs dynamic precision adjustment where the number of bits processed can be configured based on application requirements. This dynamic approach allows the system to optimize between speed and precision, processing fewer bits for faster operations when full precision is not required.

Inventive Principle:
Principle #15Dynamics

2Productivity

If conventional analog MAC designs are used, then vector-matrix multiplication can be performed, but the area of space required is large

Engineering Contradiction:
Improvecomputation capabilityVSAvoidcircuit area
Core Design Contradiction:
ProductivityVSArea of stationary object

Solution Approach 1:

The patent replaces conventional analog multiplication circuitry with a hybrid approach using one-bit DACs, simple analog multipliers, and binary-weighted summation. This substitution reduces the complexity and area of the circuit while maintaining computational capability through efficient binary decomposition and summation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the operational parameters by using one-bit digital-to-analog conversion followed by binary-weighted summation instead of direct multi-bit analog multiplication. This parameter change simplifies the individual operation components, reducing the overall circuit area while achieving the same computational result.

Inventive Principle:
Principle #35Parameter changes

3Power

If conventional MAC designs are used, then multiplication operations can be performed, but the energy consumption is significant

Engineering Contradiction:
Improvecomputational powerVSAvoidenergy consumption
Core Design Contradiction:
PowerVSUse of energy by moving object

Solution Approach 1:

The patent extracts only the essential computational function by using one-bit DACs and simple analog multipliers, removing the need for complex high-precision analog multiplication circuitry. This extraction reduces energy consumption while maintaining the core multiplication capability through efficient binary decomposition.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent uses simple, low-energy one-bit DACs and basic analog multipliers that can be rapidly switched and reconfigured, replacing energy-intensive high-precision analog components. These simpler components consume less energy per operation and can be quickly reused for subsequent calculations.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

4Measurement precision

If conventional MAC designs are used, then single-stage multiplication can be performed, but the precision and scalability are limited

Engineering Contradiction:
Improveoutput precisionVSAvoidprecision adjustment capability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic precision control by allowing configuration of the number of bits to be processed. Users can adjust the precision level based on application needs, with the system adapting the number of bit-order stages and summation precision accordingly, providing versatility across different precision requirements.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent creates a universal MAC architecture that can operate at multiple precision levels using the same hardware structure. The binary-weighted summation circuit and bit-order processing stages can handle different numbers of input bits and produce different precision outputs, making the design adaptable to various application requirements from low to high precision.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11922131B2Scalable, multi-precision, self-calibrated multiplier-accumulator architecture
Publication Date: 2024.03.05 APPLIED MATERIALS INC
  • US11922131B2 patent drawing
  • US11922131B2 patent drawing
  • US11922131B2 patent drawing

AI summary

A method for performing vector-matrix multiplication may include converting a digital input vector comprising a plurality of binary-encoded values into a plurality of analog signals using a plurality of one-bit digital to analog converters (DACs); sequentially performing, using an analog vector matrix multiplier and based on bit-order, vector-matrix multiplication operations using a weighting matrix for the plurality of analog signals to generate analog outputs of the analog vector matrix multiplier; sequentially performing an analog-to-digital (ADC) operation on the analog outputs of the analog vector matrix multiplier to generate binary partial output vectors; and combining the binary partial output vectors to generate a result of the vector-matrix multiplication.