Memristor Array Weight Modulation for In-Memory Image Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The Von Neumann architecture-based computing systems face challenges in energy efficiency and computing speed, particularly with the increasing demand for processing massive unstructured data in the era of Internet of Things and big data, where traditional CMOS devices are inadequate.

Innovation Solution

A circuit system for weight modulation and image recognition using a memristor array, comprising a personal computer, FPGA chip, digital-to-analog conversion unit, switch unit, memristor array, integration and signal amplification circuit, and analog-to-digital converter, which enables reading, writing, and weight modulation of memristor arrays, leveraging the memristor's high integration density and low power consumption for efficient computing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If Von Neumann architecture-based computing systems are used, then computational universality is achieved, but energy efficiency deteriorates and computing speed decreases when processing massive unstructured data

Engineering Contradiction:
Improveenergy efficiencyVSAvoidarchitecture complexity
Core Design Contradiction:
Use of energy by moving objectVSDevice complexity

Solution Approach 1:

The patent merges storage and computing functions into a single integrated system using memristor crossbar arrays. The memristor array simultaneously stores weight parameters and performs multiplication-accumulation operations, eliminating the separation between storage and computing units that characterizes Von Neumann architecture. This merging directly addresses the energy efficiency problem by removing the need for continuous data transfer between separate storage and computing components.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent replaces traditional electronic computing mechanisms (transistor-based logic gates and arithmetic units) with a different physical mechanism based on memristor conductance modulation. The computing operation is performed through physical phenomena (Ohm's law and Kirchhoff's current law) where current distribution through the memristor array naturally implements matrix-vector multiplication, substituting mechanical/electronic computation with a more energy-efficient physical process.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If traditional CMOS devices are used for computing, then device maturity and manufacturing readiness are maintained, but energy efficiency deteriorates and computing speed decreases for large-scale data processing

Engineering Contradiction:
Improvecomputing speedVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The memristor array performs computing operations autonomously through its physical properties. When voltage vectors are applied to the crossbar array, the current distribution automatically implements multiplication-accumulation operations based on Ohm's law and Kirchhoff's current law, without requiring external control logic or additional computational steps. This self-service capability enables high-speed computing with low power consumption.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent utilizes the continuous variability of memristor conductance as a programmable parameter to store weight values. By modulating the conductance state of individual memristors, the system can dynamically reconfigure the computational parameters (weights) without changing the physical structure or requiring additional memory writes, enabling efficient adaptation to different computing tasks.

Inventive Principle:
Principle #35Parameter changes

3Area of stationary object

If memristor cross array is used for high-density integration, then integration density and operation speed are improved, but the requirement for precise weight modulation and reading control increases

Engineering Contradiction:
Improveintegration densityVSAvoidweight modulation precision
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The patent employs dynamic control strategies for weight modulation, using pulsed voltage sequences with varying amplitudes, durations, and polarities to precisely adjust memristor conductance states. The system dynamically adapts the modulation parameters based on the desired weight values and current device states, enabling precise control despite variations in device characteristics and manufacturing tolerances.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements feedback mechanisms where the reading circuit measures the actual conductance state of memristors after modulation, and this information is used to adjust subsequent modulation operations. The feedback loop enables closed-loop control of weight parameters, compensating for manufacturing variations and ensuring precise weight values are achieved through iterative adjustment.

Inventive Principle:
Principle #23Feedback

4Loss of energy

If multiplication factors are stored directly in the memristor array, then the Von Neumann bottleneck is bypassed and energy efficiency is improved, but device complexity and control circuit requirements increase

Engineering Contradiction:
Improvecomputational energy efficiencyVSAvoidcontrol circuit complexity
Core Design Contradiction:
Loss of energyVSDevice complexity

Solution Approach 1:

The patent designs the memristor crossbar array to serve multiple functions simultaneously: it acts as both the storage medium for weight parameters and the computing engine for multiplication-accumulation operations. The same physical structure and devices are used for both storage and computation, eliminating the need for separate memory and processing units and the energy-consuming data transfer between them.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces a programmable switch network as an intermediary layer between the control logic and the memristor array. This switch network enables flexible routing and selection of rows and columns for reading and writing operations, providing the necessary control functionality while allowing the memristor array itself to focus on its core computing and storage functions without complex control circuits directly integrated at each device level.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system achieves significant energy efficiency and high-speed computing by directly storing multiplication factors in the memristor array, bypassing the Von Neumann bottleneck, and enabling efficient image recognition and weight modulation with reduced power consumption.

Implementation Method 1

The digital-to-analog conversion unit is configured to receive a digital signal sent by the FPGA chip, perform voltage reduction on the digital signal, convert the digital signal into a corresponding pulse signal

Methodology Applied
Scientific EffectDigital-to-analog conversion:

Implementation Method 2

based on Ohm's law and Kirchhoff's voltage law, the memristor array can complete multiplication and accumulation operations for a vector and a matrix in one cycle

Methodology Applied
Scientific EffectOhm's law: Ohm's Law

Implementation Method 3

based on Ohm's law and Kirchhoff's voltage law, the memristor array can complete multiplication and accumulation operations for a vector and a matrix in one cycle

Methodology Applied
Scientific EffectKirchhoff's voltage law:

Implementation Method 4

an integration and signal amplification circuit, and an analog-to-digital converter... The integration and signal amplification circuit is configured to convert the current signal output by the memristor array unit into a corresponding voltage signal, amplify the voltage signal

Methodology Applied
Scientific EffectSignal amplification:

Implementation Method 5

The analog-to-digital converter is configured to convert an analog signal output by the integration and signal amplification circuit into a corresponding digital signal

Methodology Applied
Scientific EffectAnalog-to-digital conversion:

Data Source

PatentUS11784659B2Circuit system for weight modulation and image recognition of memristor array
Publication Date: 2023.10.10 HEBEI UNIVERSITY
  • US11784659B2 patent drawing
  • US11784659B2 patent drawing
  • US11784659B2 patent drawing

AI summary

A circuit system for weight modulation and image recognition of a memristor array includes a personal computer (PC), a field-programmable gate array (FPGA) chip, a digital-to-analog conversion unit, a switch unit, a memristor array unit, an integration and signal amplification circuit, and an analog-to-digital converter. The circuit system selects a to-be-realized function such as array reading and writing, weight modulation or image recognition, converts a command or an RGB value of an image collected by the PC into a corresponding grayscale value, and sends the grayscale value to the FPGA chip. The FPGA chip controls and selects a to-be-modulated memristor array unit through the digital-to-analog conversion unit and the switch unit. An application program of the PC controls the FPGA chip in real time to realize array reading and writing, weight modulation, and image recognition, and then the FPGA chip displays a result on the PC in real time.