Analog Vector-Matrix Multiplication Circuit Using Programmable Semiconductor Array

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional matrix multiplication methods face challenges with high time complexity, high power consumption, and inefficiencies in processing large-scale data due to serial-based approaches and the need for analog-to-digital and digital-to-analog conversions in vector-matrix operations.

Innovation Solution

An analog vector-matrix multiplication circuit utilizing a programmable semiconductor device array, where the threshold voltage of each device is dynamically adjusted to perform matrix multiplication directly on analog signals, reducing the need for conversions and improving processing efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional von Neumann computing architecture is used for vector-matrix multiplication, then data can be processed through memory and processor, but data bus bandwidth consumption and transmission power consumption increase significantly

Engineering Contradiction:
Improveprocessing capabilityVSAvoidtransmission power consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent merges the memory function and processing function into a single crossbar switch architecture. The crossbar switch simultaneously serves as memory for storing matrix data and as the processing unit for performing vector-matrix multiplication, eliminating the need for separate memory and processor components and their associated data buses.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent replaces the traditional digital computing mechanism with an analog computing mechanism. By using analog voltages and currents to represent data and perform calculations directly in the analog domain through the crossbar switch, it eliminates the need for analog-to-digital and digital-to-analog conversions, thereby reducing power consumption and increasing processing speed.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If analog-to-digital and digital-to-analog conversions are performed for analog vector-matrix multiplication, then analog signals can be processed, but power consumption and cost overhead increase

Engineering Contradiction:
Improvesignal processing capabilityVSAvoidconversion power consumption
Core Design Contradiction:
Adaptability or versatilityVSLoss of energy

Solution Approach 1:

The patent replaces the digital conversion mechanism with direct analog computation. The crossbar switch performs vector-matrix multiplication using analog voltages and currents, allowing the system to process analog signals directly without requiring analog-to-digital or digital-to-analog conversion stages, thereby eliminating the associated power consumption and cost overhead.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of manufacture

If serial-based approach is used for matrix multiplication, then calculation can be performed on traditional computers, but calculation time increases for large-scale data

Engineering Contradiction:
Improveimplementation simplicityVSAvoidcalculation time
Core Design Contradiction:
Ease of manufactureVSLoss of time

Solution Approach 1:

The patent segments the matrix multiplication operation into parallel operations across multiple crossbar switch elements. Each element in the crossbar array simultaneously performs multiplication and accumulation operations on different data elements, transforming a serial process into a highly parallel operation that completes in a single computational step.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies preliminary action by pre-configuring the crossbar switch with matrix data in memory before the multiplication operation. This allows the actual computation to proceed rapidly without data retrieval delays, as all necessary data is already positioned in the processing architecture.

Inventive Principle:
Principle #10Preliminary action

4Productivity

If distributed algorithm is used for matrix multiplication, then parallelization is achieved, but performance is limited by bottlenecks

Engineering Contradiction:
Improveparallel processing efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent merges memory and processing functions into a unified crossbar switch architecture, eliminating the complexity of distributed systems with separate memory and processing units. This integration allows parallel operations to occur without the communication overhead and coordination complexity inherent in distributed algorithms.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The circuit significantly reduces overhead from data conversions and transmission, enhances processing performance, and improves power efficiency by directly performing vector-matrix operations on analog signals without the need for digital intermediates.

Implementation Method 1

the threshold voltage of each programmable semiconductor device can be adjusted

Methodology Applied
Scientific EffectThreshold voltage modulation:

Implementation Method 2

In the programmable semiconductor device array, the gates of all programmable semiconductor devices in each row are connected to the same analog voltage input end

Methodology Applied
Scientific EffectField effect transistor operation:

Implementation Method 3

the drains of all programmable semiconductor devices in each column are connected to the same first end, a plurality of columns of programmable semiconductor devices are correspondingly connected to a plurality of first ends, the sources of all programmable semiconductor devices in each column are connected to the same second end

Methodology Applied
Scientific EffectKirchhoff's current law:

Data Source

PatentUS11379673B2Analog vector-matrix multiplication circuit
Publication Date: 2022.07.05 BEIJING ZHICUN (WITIN) TECH CORP LTD
  • US11379673B2 patent drawing
  • US11379673B2 patent drawing
  • US11379673B2 patent drawing

AI summary

An analog vector-matrix multiplication circuit is achieved by using a programmable storage device array. In a programmable semiconductor device array, gates of all of programmable semiconductor devices of each row are all connected to the same analog voltage input end. M rows of programmable semiconductor devices are correspondingly connected to M analog voltage input ends. Drains (or sources) of all of programmable semiconductor devices of each column are all connected to the same bias voltage input end. N columns of programmable semiconductor devices are correspondingly connected to N bias voltage input ends. Sources (or drains) of all of programmable semiconductor devices of each column are all connected to the same analog current output end. The N columns of programmable semiconductor devices are correspondingly connected to N analog current output ends. Threshold voltages of the programmable semiconductor devices are controlled, such that each programmable semiconductor device can be regarded as a variable equivalent analog weight, thereby achieving the matrix multiplication function.